Nov 10 22:30:13 user nova-compute[75288]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75288) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 22:30:13 user nova-compute[75288]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75288) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 22:30:13 user nova-compute[75288]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75288) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 22:30:13 user nova-compute[75288]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 22:30:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:30:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:30:13 user nova-compute[75288]: INFO nova.virt.driver [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 22:30:13 user nova-compute[75288]: INFO nova.compute.provider_config [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Acquiring lock "singleton_lock" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Acquired lock "singleton_lock" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Releasing lock "singleton_lock" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Full set of CONF: {{(pid=75288) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ******************************************************************************** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Configuration options gathered from: {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ================================================================================ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] allow_resize_to_same_host      = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] arq_binding_timeout            = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] backdoor_port                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] backdoor_socket                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] block_device_allocate_retries  = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] block_device_allocate_retries_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cert                           = self.pem {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute_monitors               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] config_dir                     = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] config_drive_format            = iso9660 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] config_source                  = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] console_host                   = user {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] control_exchange               = nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cpu_allocation_ratio           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] daemon                         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] debug                          = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] default_access_ip_network_name = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] default_availability_zone      = nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] default_ephemeral_format       = ext4 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] default_green_pool_size        = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] default_schedule_zone          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] disk_allocation_ratio          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] enable_new_services            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] enabled_ssl_apis               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] flat_injected                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] force_config_drive             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] force_raw_images               = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] graceful_shutdown_timeout      = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] heal_instance_info_cache_interval = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] host                           = user {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instance_build_timeout         = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instance_delete_interval       = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instance_name_template         = instance-%08x {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instance_usage_audit           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instance_usage_audit_period    = month {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] internal_service_availability_zone = internal {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] key                            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] live_migration_retry_count     = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_config_append              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_dir                        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_file                       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_options                    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_rotate_interval            = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_rotate_interval_type       = days {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] log_rotation_type              = none {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] long_rpc_timeout               = 1800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] max_concurrent_builds          = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] max_concurrent_live_migrations = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] max_concurrent_snapshots       = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] max_local_block_devices        = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] max_logfile_count              = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] max_logfile_size_mb            = 200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] maximum_instance_delete_attempts = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] metadata_listen                = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] metadata_listen_port           = 8775 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] metadata_workers               = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] migrate_max_retries            = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] mkisofs_cmd                    = genisoimage {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] my_ip                          = 10.0.0.210 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] network_allocate_retries       = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] osapi_compute_listen_port      = 8774 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] osapi_compute_unique_server_name_scope =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] osapi_compute_workers          = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] password_length                = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] periodic_enable                = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] periodic_fuzzy_delay           = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] pointer_model                  = ps2mouse {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] preallocate_images             = none {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] publish_errors                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] pybasedir                      = /opt/stack/nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ram_allocation_ratio           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rate_limit_burst               = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rate_limit_except_level        = CRITICAL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rate_limit_interval            = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] reboot_timeout                 = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] reclaim_instance_interval      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] record                         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] reimage_timeout_per_gb         = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] report_interval                = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rescue_timeout                 = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] reserved_host_cpus             = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] reserved_host_disk_mb          = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] reserved_host_memory_mb        = 512 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] reserved_huge_pages            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] resize_confirm_window          = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] resize_fs_using_block_device   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] resume_guests_state_on_host_boot = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rpc_response_timeout           = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] run_external_periodic_tasks    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] running_deleted_instance_action = reap {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] running_deleted_instance_timeout = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler_instance_sync_interval = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_down_time              = 720 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] servicegroup_driver            = db {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] shelved_offload_time           = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] shelved_poll_interval          = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] shutdown_timeout               = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] source_is_ipv6                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ssl_only                       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] state_path                     = /opt/stack/data/nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] sync_power_state_interval      = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] sync_power_state_pool_size     = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] syslog_log_facility            = LOG_USER {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] tempdir                        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] timeout_nbd                    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] transport_url                  = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] update_resources_interval      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] use_cow_images                 = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] use_eventlog                   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] use_journal                    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] use_json                       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] use_rootwrap_daemon            = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] use_stderr                     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] use_syslog                     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vcpu_pin_set                   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plugging_is_fatal          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plugging_timeout           = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] virt_mkfs                      = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] volume_usage_poll_interval     = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] watch_log_file                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] web                            = /usr/share/spice-html5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_concurrency.disable_process_locking = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.auth_strategy              = keystone {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.compute_link_prefix        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.dhcp_domain                = novalocal {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.enable_instance_password   = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.glance_link_prefix         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.instance_list_per_project_cells = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.list_records_by_skipping_down_cells = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.local_metadata_per_cell    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.max_limit                  = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.metadata_cache_expiration  = 15 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.neutron_default_tenant_id  = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.use_forwarded_for          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.use_neutron_default_nets   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.vendordata_dynamic_targets = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.vendordata_jsonfile_path   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.backend_argument         = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.config_prefix            = cache.oslo {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.dead_timeout             = 60.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.debug_cache_backend      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.enable_retry_client      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.enable_socket_keepalive  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.enabled                  = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.expiration_time          = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.hashclient_retry_attempts = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_dead_retry      = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_password        =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_sasl_enabled    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.memcache_username        =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.proxies                  = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.retry_attempts           = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.retry_delay              = 0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.socket_keepalive_count   = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.socket_keepalive_idle    = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.socket_keepalive_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.tls_allowed_ciphers      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.tls_cafile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.tls_certfile             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.tls_enabled              = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cache.tls_keyfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.auth_section            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.auth_type               = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.cross_az_attach         = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.debug                   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.endpoint_template       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.http_retries            = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.os_region_name          = RegionOne {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cinder.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.cpu_dedicated_set      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.cpu_shared_set         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.image_type_exclude_list = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.resource_provider_association_refresh = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.shutdown_retry_interval = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] conductor.workers              = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] console.allowed_origins        = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] console.ssl_ciphers            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] console.ssl_minimum_version    = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] consoleauth.token_ttl          = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.connect_retries         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.connect_retry_delay     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.endpoint_override       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.max_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.min_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.region_name             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.service_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.service_type            = accelerator {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.status_code_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] cyborg.version                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.backend               = sqlalchemy {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.connection            = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.connection_debug      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.connection_parameters =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.connection_recycle_time = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.connection_trace      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.db_inc_retry_interval = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.db_max_retries        = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.db_max_retry_interval = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.db_retry_interval     = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.max_overflow          = 50 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.max_pool_size         = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.max_retries           = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.mysql_wsrep_sync_wait = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.pool_timeout          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.retry_interval        = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.slave_connection      = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] database.sqlite_synchronous    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.backend           = sqlalchemy {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.connection        = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.connection_debug  = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.connection_parameters =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.connection_recycle_time = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.connection_trace  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.db_inc_retry_interval = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.db_max_retries    = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.db_max_retry_interval = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.db_retry_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.max_overflow      = 50 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.max_pool_size     = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.max_retries       = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.pool_timeout      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.retry_interval    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.slave_connection  = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] api_database.sqlite_synchronous = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] devices.enabled_mdev_types     = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ephemeral_storage_encryption.enabled = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.api_servers             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.connect_retries         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.connect_retry_delay     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.debug                   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.default_trusted_certificate_ids = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.enable_certificate_validation = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.enable_rbd_download     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.endpoint_override       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.max_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.min_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.num_retries             = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.rbd_ceph_conf           =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.rbd_connect_timeout     = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.rbd_pool                =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.rbd_user                =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.region_name             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.service_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.service_type            = image {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.status_code_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.verify_glance_signatures = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] glance.version                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] guestfs.debug                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.config_drive_cdrom      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.config_drive_inject_password = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.enable_remotefx         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.instances_path_share    =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.limit_cpu_features      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.use_multipath_io        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.vswitch_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] mks.enabled                    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] image_cache.manager_interval   = 2400 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] image_cache.precache_concurrency = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] image_cache.remove_unused_base_images = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] image_cache.subdirectory_name  = _base {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.api_max_retries         = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.api_retry_interval      = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.auth_section            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.auth_type               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.conductor_group         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.connect_retries         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.connect_retry_delay     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.endpoint_override       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.max_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.min_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.peer_list               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.region_name             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.serial_console_state_timeout = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.service_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.service_type            = baremetal {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.status_code_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ironic.version                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] key_manager.fixed_key          = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.barbican_api_version  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.barbican_endpoint     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.barbican_endpoint_type = public {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.barbican_region_name  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.cafile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.certfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.collect_timing        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.insecure              = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.keyfile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.number_of_retries     = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.retry_delay           = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.send_service_user_token = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.split_loggers         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.timeout               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.verify_ssl            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican.verify_ssl_path       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.auth_section = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.auth_type = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.cafile   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.certfile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.collect_timing = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.insecure = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.keyfile  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.split_loggers = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] barbican_service_user.timeout  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.approle_role_id          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.approle_secret_id        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.cafile                   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.certfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.collect_timing           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.insecure                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.keyfile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.kv_mountpoint            = secret {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.kv_path                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.kv_version               = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.namespace                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.root_token_id            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.split_loggers            = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.ssl_ca_crt_file          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.timeout                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.use_ssl                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.auth_section          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.auth_type             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.cafile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.certfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.collect_timing        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.connect_retries       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.connect_retry_delay   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.endpoint_override     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.insecure              = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.keyfile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.max_version           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.min_version           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.region_name           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.service_name          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.service_type          = identity {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.split_loggers         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.status_code_retries   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.timeout               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] keystone.version               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.connection_uri         =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.cpu_mode               = custom {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: WARNING oslo_config.cfg [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.cpu_power_governor_high = performance {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.cpu_power_management   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.device_detach_attempts = 8 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.device_detach_timeout  = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.disk_cachemodes        = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.disk_prefix            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.enabled_perf_events    = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.file_backed_memory     = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.gid_maps               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.hw_disk_discard        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.hw_machine_type        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.images_rbd_pool        = rbd {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.images_type            = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.images_volume_group    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.inject_key             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.inject_partition       = -2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.inject_password        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.iscsi_iface            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.iser_use_multipath     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_downtime = 500 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_inbound_addr = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_scheme  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_timeout_action = abort {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_tunnelled = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: WARNING oslo_config.cfg [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 22:30:14 user nova-compute[75288]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 22:30:14 user nova-compute[75288]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 22:30:14 user nova-compute[75288]: and ``live_migration_inbound_addr`` respectively.
Nov 10 22:30:14 user nova-compute[75288]: ).  Its value may be silently ignored in the future.
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.live_migration_with_native_tls = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.max_queues             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.nfs_mount_options      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.num_pcie_ports         = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.pmem_namespaces        = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.quobyte_client_cfg     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rbd_secret_uuid        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rbd_user               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rescue_image_id        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rescue_kernel_id       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.rx_queue_size          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.smbfs_mount_options    =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.snapshot_compression   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.snapshot_image_format  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.sparse_logical_volumes = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.swtpm_enabled          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.swtpm_group            = tss {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.swtpm_user             = tss {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.sysinfo_serial         = unique {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.tb_cache_size          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.tx_queue_size          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.uid_maps               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.use_virtio_for_bridges = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.virt_type              = kvm {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.volume_clear           = zero {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.volume_clear_size      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.volume_use_multipath   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.vzstorage_cache_path   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.auth_section           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.auth_type              = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.cafile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.certfile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.collect_timing         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.connect_retries        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.connect_retry_delay    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.default_floating_pool  = public {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.endpoint_override      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.extension_sync_interval = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.http_retries           = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.insecure               = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.keyfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.max_version            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.min_version            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.ovs_bridge             = br-int {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.physnets               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.region_name            = RegionOne {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.service_metadata_proxy = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.service_name           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.service_type           = network {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.split_loggers          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.status_code_retries    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.timeout                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] neutron.version                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] notifications.bdms_in_notifications = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] notifications.default_level    = INFO {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] notifications.notification_format = unversioned {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] notifications.notify_on_state_change = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] pci.alias                      = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] pci.device_spec                = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] pci.report_in_placement        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.auth_section         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.auth_type            = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.cafile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.certfile             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.collect_timing       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.connect_retries      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.connect_retry_delay  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.default_domain_id    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.default_domain_name  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.domain_id            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.domain_name          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.endpoint_override    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.insecure             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.keyfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.max_version          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.min_version          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.password             = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.project_domain_id    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.project_domain_name  = Default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.project_id           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.project_name         = service {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.region_name          = RegionOne {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.service_name         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.service_type         = placement {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.split_loggers        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.status_code_retries  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.system_scope         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.timeout              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.trust_id             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.user_domain_id       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.user_domain_name     = Default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.user_id              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.username             = placement {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] placement.version              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.cores                    = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.count_usage_from_placement = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.injected_file_content_bytes = 10240 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.injected_file_path_length = 255 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.injected_files           = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.instances                = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.key_pairs                = 100 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.metadata_items           = 128 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.ram                      = 51200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.recheck_quota            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.server_group_members     = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] quota.server_groups            = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rdp.enabled                    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.image_metadata_prefilter = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.max_attempts         = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.max_placement_results = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] scheduler.workers              = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.host_subset_size = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.isolated_hosts = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.isolated_images = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.pci_in_placement = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.track_instance_changes = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] metrics.required               = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] metrics.weight_multiplier      = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] metrics.weight_setting         = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] serial_console.enabled         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] serial_console.port_range      = 10000:20000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] serial_console.serialproxy_port = 6083 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.auth_section      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.auth_type         = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.cafile            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.certfile          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.collect_timing    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.insecure          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.keyfile           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.send_service_user_token = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.split_loggers     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] service_user.timeout           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.agent_enabled            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.enabled                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.html5proxy_port          = 6082 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.image_compression        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.jpeg_compression         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.playback_compression     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.server_listen            = 127.0.0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.streaming_mode           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] spice.zlib_compression         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] upgrade_levels.baseapi         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] upgrade_levels.cert            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] upgrade_levels.compute         = auto {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] upgrade_levels.conductor       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] upgrade_levels.scheduler       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.cafile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.certfile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.insecure = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vendordata_dynamic_auth.timeout = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.api_retry_count         = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.ca_file                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.cache_prefix            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.cluster_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.connection_pool_size    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.console_delay_seconds   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.datastore_regex         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.host_ip                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.host_password           = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.host_port               = 443 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.host_username           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.integration_bridge      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.maximum_objects         = 100 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.pbm_default_policy      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.pbm_enabled             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.pbm_wsdl_location       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.serial_port_proxy_uri   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.serial_port_service_uri = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.task_poll_interval      = 0.5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.use_linked_clone        = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.vnc_keymap              = en-us {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.vnc_port                = 5900 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vmware.vnc_port_total          = 10000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.auth_schemes               = ['none'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.enabled                    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.novncproxy_port            = 6080 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.vencrypt_ca_certs          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.vencrypt_client_cert       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vnc.vencrypt_client_key        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.disable_rootwrap   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.enable_numa_live_migration = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.libvirt_disable_apic = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.client_socket_timeout     = 900 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.default_pool_size         = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.keep_alive                = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.max_header_line           = 16384 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.ssl_ca_file               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.ssl_cert_file             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.ssl_key_file              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.tcp_keepidle              = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] zvm.ca_file                    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] zvm.cloud_connector_url        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] zvm.reachable_timeout          = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.enforce_new_defaults = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.enforce_scope      = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.policy_default_rule = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.connection_string     = messaging:// {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.enabled               = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.es_doc_type           = notification {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.es_scroll_size        = 10000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.es_scroll_time        = 2m {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.filter_error_trace    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.hmac_keys             = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.sentinel_service_name = mymaster {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.socket_timeout        = 0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.trace_requests        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler.trace_sqlalchemy      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler_jaeger.process_tags   = {} {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler_jaeger.service_name_prefix = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] profiler_otlp.service_name_prefix = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] remote_debug.host              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] remote_debug.port              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_notifications.retry = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.auth_section        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.auth_type           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.cafile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.certfile            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.collect_timing      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.connect_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.connect_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.endpoint_id         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.endpoint_override   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.insecure            = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.keyfile             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.max_version         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.min_version         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.region_name         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.service_name        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.service_type        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.split_loggers       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.status_code_retries = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.timeout             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.valid_interfaces    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_limit.version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_reports.file_event_handler = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] oslo_reports.log_dir           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_ovs_privileged.group  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] vif_plug_ovs_privileged.user   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_ovs.isolate_vif         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] os_brick.lock_path             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] privsep_osbrick.capabilities   = [21] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] privsep_osbrick.group          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] privsep_osbrick.helper_command = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] privsep_osbrick.user           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] nova_sys_admin.group           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] nova_sys_admin.helper_command  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] nova_sys_admin.user            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG oslo_service.service [None req-414eadfa-1643-4e8f-b34d-e9361e572b26 None None] ******************************************************************************** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 22:30:14 user nova-compute[75288]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 22:30:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Connecting to libvirt: qemu:///system {{(pid=75288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4b286270a0> {{(pid=75288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 22:30:14 user nova-compute[75288]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 22:30:14 user nova-compute[75288]: WARNING nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 22:30:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4b286270a0> {{(pid=75288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Starting native event thread {{(pid=75288) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Starting green dispatch thread {{(pid=75288) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 22:30:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Starting connection event dispatch thread {{(pid=75288) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 22:30:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Connection event '1' reason 'None'
Nov 10 22:30:14 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 22:30:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.mount [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Initialising _HostMountState generation 0 {{(pid=75288) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 22:30:21 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host capabilities <capabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <host>
Nov 10 22:30:21 user nova-compute[75288]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 22:30:21 user nova-compute[75288]:     <cpu>
Nov 10 22:30:21 user nova-compute[75288]:       <arch>x86_64</arch>
Nov 10 22:30:21 user nova-compute[75288]:       <model>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <microcode version='1070'/>
Nov 10 22:30:21 user nova-compute[75288]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 22:30:21 user nova-compute[75288]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='osxsave'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='invtsc'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='rsba'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 22:30:21 user nova-compute[75288]:       <pages unit='KiB' size='4'/>
Nov 10 22:30:21 user nova-compute[75288]:       <pages unit='KiB' size='2048'/>
Nov 10 22:30:21 user nova-compute[75288]:     </cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <power_management>
Nov 10 22:30:21 user nova-compute[75288]:       <suspend_mem/>
Nov 10 22:30:21 user nova-compute[75288]:       <suspend_disk/>
Nov 10 22:30:21 user nova-compute[75288]:       <suspend_hybrid/>
Nov 10 22:30:21 user nova-compute[75288]:     </power_management>
Nov 10 22:30:21 user nova-compute[75288]:     <iommu support='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <migration_features>
Nov 10 22:30:21 user nova-compute[75288]:       <live/>
Nov 10 22:30:21 user nova-compute[75288]:       <uri_transports>
Nov 10 22:30:21 user nova-compute[75288]:         <uri_transport>tcp</uri_transport>
Nov 10 22:30:21 user nova-compute[75288]:         <uri_transport>rdma</uri_transport>
Nov 10 22:30:21 user nova-compute[75288]:       </uri_transports>
Nov 10 22:30:21 user nova-compute[75288]:     </migration_features>
Nov 10 22:30:21 user nova-compute[75288]:     <topology>
Nov 10 22:30:21 user nova-compute[75288]:       <cells num='2'>
Nov 10 22:30:21 user nova-compute[75288]:         <cell id='0'>
Nov 10 22:30:21 user nova-compute[75288]:           <memory unit='KiB'>8140616</memory>
Nov 10 22:30:21 user nova-compute[75288]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 10 22:30:21 user nova-compute[75288]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 22:30:21 user nova-compute[75288]:           <distances>
Nov 10 22:30:21 user nova-compute[75288]:             <sibling id='0' value='10'/>
Nov 10 22:30:21 user nova-compute[75288]:             <sibling id='1' value='20'/>
Nov 10 22:30:21 user nova-compute[75288]:           </distances>
Nov 10 22:30:21 user nova-compute[75288]:           <cpus num='6'>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 22:30:21 user nova-compute[75288]:           </cpus>
Nov 10 22:30:21 user nova-compute[75288]:         </cell>
Nov 10 22:30:21 user nova-compute[75288]:         <cell id='1'>
Nov 10 22:30:21 user nova-compute[75288]:           <memory unit='KiB'>8255068</memory>
Nov 10 22:30:21 user nova-compute[75288]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 10 22:30:21 user nova-compute[75288]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 22:30:21 user nova-compute[75288]:           <distances>
Nov 10 22:30:21 user nova-compute[75288]:             <sibling id='0' value='20'/>
Nov 10 22:30:21 user nova-compute[75288]:             <sibling id='1' value='10'/>
Nov 10 22:30:21 user nova-compute[75288]:           </distances>
Nov 10 22:30:21 user nova-compute[75288]:           <cpus num='6'>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 22:30:21 user nova-compute[75288]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 22:30:21 user nova-compute[75288]:           </cpus>
Nov 10 22:30:21 user nova-compute[75288]:         </cell>
Nov 10 22:30:21 user nova-compute[75288]:       </cells>
Nov 10 22:30:21 user nova-compute[75288]:     </topology>
Nov 10 22:30:21 user nova-compute[75288]:     <cache>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 22:30:21 user nova-compute[75288]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 22:30:21 user nova-compute[75288]:     </cache>
Nov 10 22:30:21 user nova-compute[75288]:     <secmodel>
Nov 10 22:30:21 user nova-compute[75288]:       <model>apparmor</model>
Nov 10 22:30:21 user nova-compute[75288]:       <doi>0</doi>
Nov 10 22:30:21 user nova-compute[75288]:     </secmodel>
Nov 10 22:30:21 user nova-compute[75288]:     <secmodel>
Nov 10 22:30:21 user nova-compute[75288]:       <model>dac</model>
Nov 10 22:30:21 user nova-compute[75288]:       <doi>0</doi>
Nov 10 22:30:21 user nova-compute[75288]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 22:30:21 user nova-compute[75288]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 22:30:21 user nova-compute[75288]:     </secmodel>
Nov 10 22:30:21 user nova-compute[75288]:   </host>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='alpha'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>clipper</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='armv6l'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>spitz</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>nuri</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>kzm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sx1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>z2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>tosa</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>n810</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>n800</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>terrier</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>midway</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>microbit</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>verdex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>highbank</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>akita</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>connex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>collie</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='armv7l'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>spitz</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>nuri</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>kzm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sx1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>z2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>tosa</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>n810</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>n800</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>terrier</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>midway</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>microbit</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>verdex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>highbank</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>akita</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>connex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>collie</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='aarch64'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>spitz</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>nuri</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>kzm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sx1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>z2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>tosa</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>n810</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>n800</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>terrier</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>midway</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>microbit</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>verdex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>highbank</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>akita</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>connex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>collie</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <acpi default='on' toggle='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='cris'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='i686'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>isapc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>microvm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='kvm'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <pae/>
Nov 10 22:30:21 user nova-compute[75288]:       <nonpae/>
Nov 10 22:30:21 user nova-compute[75288]:       <acpi default='on' toggle='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:       <apic default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='m68k'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>an5206</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>q800</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='microblaze'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='microblazeel'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='mips'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='mipsel'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='mips64'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>pica61</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>magnum</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='mips64el'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>pica61</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>magnum</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='16'>boston</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='ppc'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mac99</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>40p</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>taihu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='ppc64'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>taihu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>40p</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mac99</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='ppc64le'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>taihu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>40p</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>mac99</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='riscv32'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='8'>spike</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='8'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='riscv64'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='8'>spike</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='8'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='s390x'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='sh4'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>shix</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>r2d</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='sh4eb'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>shix</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>r2d</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='sparc'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>LX</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='sparc64'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>niagara</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='x86_64'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>64</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='1'>isapc</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>microvm</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='kvm'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <acpi default='on' toggle='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:       <apic default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='xtensa'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>sim</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>kc705</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>ml605</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx200</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx60</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]:   <guest>
Nov 10 22:30:21 user nova-compute[75288]:     <os_type>hvm</os_type>
Nov 10 22:30:21 user nova-compute[75288]:     <arch name='xtensaeb'>
Nov 10 22:30:21 user nova-compute[75288]:       <wordsize>32</wordsize>
Nov 10 22:30:21 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='4'>sim</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>kc705</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>ml605</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>virt</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx200</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>lx60</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 22:30:21 user nova-compute[75288]:       <domain type='qemu'/>
Nov 10 22:30:21 user nova-compute[75288]:     </arch>
Nov 10 22:30:21 user nova-compute[75288]:     <features>
Nov 10 22:30:21 user nova-compute[75288]:       <cpuselection/>
Nov 10 22:30:21 user nova-compute[75288]:       <deviceboot/>
Nov 10 22:30:21 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     </features>
Nov 10 22:30:21 user nova-compute[75288]:   </guest>
Nov 10 22:30:21 user nova-compute[75288]: </capabilities>
Nov 10 22:30:21 user nova-compute[75288]: 
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-i440fx-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>i686</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='255'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'/>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ide</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-i440fx-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>i686</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='255'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'/>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ide</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-q35-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>i686</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='288'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'/>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-q35-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>i686</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='288'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'/>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-i440fx-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>x86_64</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='255'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>efi</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ide</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-i440fx-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>x86_64</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='255'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>efi</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ide</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-q35-jammy</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>x86_64</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='288'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>efi</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 22:30:21 user nova-compute[75288]: <domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 22:30:21 user nova-compute[75288]:   <domain>kvm</domain>
Nov 10 22:30:21 user nova-compute[75288]:   <machine>pc-q35-6.2</machine>
Nov 10 22:30:21 user nova-compute[75288]:   <arch>x86_64</arch>
Nov 10 22:30:21 user nova-compute[75288]:   <vcpu max='288'/>
Nov 10 22:30:21 user nova-compute[75288]:   <iothreads supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:   <os supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='firmware'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>efi</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:     <loader supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>rom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pflash</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='readonly'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='secure'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>yes</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>no</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </loader>
Nov 10 22:30:21 user nova-compute[75288]:   </os>
Nov 10 22:30:21 user nova-compute[75288]:   <cpu>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='maximumMigratable'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>on</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>off</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <vendor>Intel</vendor>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Nov 10 22:30:21 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>phenom</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>n270</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>athlon</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Nov 10 22:30:21 user nova-compute[75288]:       <model usable='yes'>486</model>
Nov 10 22:30:21 user nova-compute[75288]:     </mode>
Nov 10 22:30:21 user nova-compute[75288]:   </cpu>
Nov 10 22:30:21 user nova-compute[75288]:   <memoryBacking supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:     <enum name='sourceType'>
Nov 10 22:30:21 user nova-compute[75288]:       <value>file</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>anonymous</value>
Nov 10 22:30:21 user nova-compute[75288]:       <value>memfd</value>
Nov 10 22:30:21 user nova-compute[75288]:     </enum>
Nov 10 22:30:21 user nova-compute[75288]:   </memoryBacking>
Nov 10 22:30:21 user nova-compute[75288]:   <devices>
Nov 10 22:30:21 user nova-compute[75288]:     <disk supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='diskDevice'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>disk</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cdrom</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>floppy</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>lun</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='bus'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>fdc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sata</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </disk>
Nov 10 22:30:21 user nova-compute[75288]:     <graphics supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='type'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>sdl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vnc</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>spice</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egl-headless</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </graphics>
Nov 10 22:30:21 user nova-compute[75288]:     <video supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='modelType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>cirrus</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>vmvga</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>qxl</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>none</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>bochs</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>ramfb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </video>
Nov 10 22:30:21 user nova-compute[75288]:     <hostdev supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='mode'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>subsystem</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='startupPolicy'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>default</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>mandatory</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>requisite</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>optional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='subsysType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>usb</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>pci</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>scsi</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='capsType'/>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='pciBackend'/>
Nov 10 22:30:21 user nova-compute[75288]:     </hostdev>
Nov 10 22:30:21 user nova-compute[75288]:     <rng supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>random</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>egd</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>builtin</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </rng>
Nov 10 22:30:21 user nova-compute[75288]:     <filesystem supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='driverType'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>path</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>handle</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>virtiofs</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </filesystem>
Nov 10 22:30:21 user nova-compute[75288]:     <tpm supported='yes'>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='model'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-tis</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>tpm-crb</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:       <enum name='backendModel'>
Nov 10 22:30:21 user nova-compute[75288]:         <value>passthrough</value>
Nov 10 22:30:21 user nova-compute[75288]:         <value>emulator</value>
Nov 10 22:30:21 user nova-compute[75288]:       </enum>
Nov 10 22:30:21 user nova-compute[75288]:     </tpm>
Nov 10 22:30:21 user nova-compute[75288]:   </devices>
Nov 10 22:30:21 user nova-compute[75288]:   <features>
Nov 10 22:30:21 user nova-compute[75288]:     <gic supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <genid supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <backup supported='yes'/>
Nov 10 22:30:21 user nova-compute[75288]:     <sev supported='no'/>
Nov 10 22:30:21 user nova-compute[75288]:   </features>
Nov 10 22:30:21 user nova-compute[75288]: </domainCapabilities>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Checking secure boot support for host arch (x86_64) {{(pid=75288) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Checking secure boot support for host arch (x86_64) {{(pid=75288) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Checking secure boot support for host arch (x86_64) {{(pid=75288) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Checking secure boot support for host arch (x86_64) {{(pid=75288) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Checking secure boot support for host arch (x86_64) {{(pid=75288) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 22:30:21 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Secure Boot support detected
Nov 10 22:30:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] cpu compare xml: <cpu match="exact">
Nov 10 22:30:21 user nova-compute[75288]:   <model>Nehalem</model>
Nov 10 22:30:21 user nova-compute[75288]: </cpu>
Nov 10 22:30:21 user nova-compute[75288]:  {{(pid=75288) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 22:30:21 user nova-compute[75288]: INFO nova.virt.node [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Generated node identity b11c524c-1236-4192-b3e8-15e79f5f3ca6
Nov 10 22:30:21 user nova-compute[75288]: INFO nova.virt.node [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Wrote node identity b11c524c-1236-4192-b3e8-15e79f5f3ca6 to /opt/stack/data/nova/compute_id
Nov 10 22:30:21 user nova-compute[75288]: WARNING nova.compute.manager [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Compute nodes ['b11c524c-1236-4192-b3e8-15e79f5f3ca6'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 22:30:21 user nova-compute[75288]: INFO nova.compute.manager [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 22:30:22 user nova-compute[75288]: WARNING nova.compute.manager [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 22:30:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:30:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:30:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Hypervisor/Node resource view: name=user free_ram=10968MB free_disk=26.217632293701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:30:22 user nova-compute[75288]: WARNING nova.compute.resource_tracker [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] No compute node record for user:b11c524c-1236-4192-b3e8-15e79f5f3ca6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b11c524c-1236-4192-b3e8-15e79f5f3ca6 could not be found.
Nov 10 22:30:22 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Compute node record created for user:user with uuid: b11c524c-1236-4192-b3e8-15e79f5f3ca6
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:30:22 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] [req-e2df0944-f607-42af-b4ea-b65ecd2edb3c] Created resource provider record via placement API for resource provider with UUID b11c524c-1236-4192-b3e8-15e79f5f3ca6 and name user.
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75288) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 22:30:22 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] kernel doesn't support AMD SEV
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Libvirt baseline CPU <cpu>
Nov 10 22:30:22 user nova-compute[75288]:   <arch>x86_64</arch>
Nov 10 22:30:22 user nova-compute[75288]:   <model>Nehalem</model>
Nov 10 22:30:22 user nova-compute[75288]:   <vendor>Intel</vendor>
Nov 10 22:30:22 user nova-compute[75288]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 22:30:22 user nova-compute[75288]: </cpu>
Nov 10 22:30:22 user nova-compute[75288]:  {{(pid=75288) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Updated inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Updating resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 generation from 0 to 1 during operation: update_inventory {{(pid=75288) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 22:30:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 22:30:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Updating resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 generation from 1 to 2 during operation: update_traits {{(pid=75288) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 22:30:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:30:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:30:23 user nova-compute[75288]: DEBUG nova.service [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Creating RPC server for service compute {{(pid=75288) start /opt/stack/nova/nova/service.py:182}}
Nov 10 22:30:23 user nova-compute[75288]: DEBUG nova.service [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] Join ServiceGroup membership for this service compute {{(pid=75288) start /opt/stack/nova/nova/service.py:199}}
Nov 10 22:30:23 user nova-compute[75288]: DEBUG nova.servicegroup.drivers.db [None req-599be6b5-1796-4a6c-ad7d-8eb4df30314d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75288) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 22:31:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:31:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:31:14 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:31:14 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:31:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=10396MB free_disk=26.121498107910156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:31:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:32:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:32:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:32:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:32:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=10315MB free_disk=26.18610382080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:32:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:32:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:32:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:33:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:33:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:33:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:33:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:33:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:33:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:33:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=10302MB free_disk=25.93844223022461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:33:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:33:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:34:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=9641MB free_disk=25.967090606689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:34:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:34:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:34:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:34:25 user nova-compute[75288]: INFO nova.compute.claims [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Claim successful on node user
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:34:26 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:34:26 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Creating image(s)
Nov 10 22:34:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "/opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "/opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "/opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:26 user nova-compute[75288]: DEBUG nova.policy [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07d1ae0425e64057b3b2220d4bb02624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4325393aa3434c2a87912895d4574812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG nova.virt.images [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] f7c29f6c-dbb5-44ff-8be6-262881085121 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.part /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:34:27 user nova-compute[75288]: INFO nova.compute.claims [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Claim successful on node user
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.part /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.converted" returned: 0 in 0.161s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.589s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:28 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpefgdezyn/privsep.sock']
Nov 10 22:34:28 user sudo[84536]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpefgdezyn/privsep.sock
Nov 10 22:34:28 user sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 22:34:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:34:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:34:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Creating image(s)
Nov 10 22:34:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "/opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "/opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "/opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:28 user nova-compute[75288]: DEBUG nova.policy [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b2cda6074654069b7a96c0b62c75834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb5971c1a0740ed8c88bb3985e78ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:34:29 user sudo[84536]: pam_unix(sudo:session): session closed for user root
Nov 10 22:34:29 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Spawned new privsep daemon via rootwrap
Nov 10 22:34:29 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 22:34:29 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 22:34:29 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 22:34:29 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84539
Nov 10 22:34:29 user nova-compute[75288]: WARNING oslo_privsep.priv_context [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] privsep daemon already running
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk 1073741824" returned: 0 in 0.052s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.263s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk 1073741824" returned: 0 in 0.055s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Cannot resize image /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Ensure instance console log exists: /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Successfully created port: 3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Cannot resize image /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Ensure instance console log exists: /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:30 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:34:30 user nova-compute[75288]: INFO nova.compute.claims [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Claim successful on node user
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:34:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:34:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Creating image(s)
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Successfully created port: 8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG nova.policy [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05f170ae42004d57abea1bf318d05dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f6c30d0f1a467f8e977a73463e2d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk 1073741824" returned: 0 in 0.040s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Cannot resize image /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Ensure instance console log exists: /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Successfully updated port: 3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquired lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.network.neutron [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-changed-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Refreshing instance network info cache due to event network-changed-3c33009f-d20a-4dd9-8e7a-134b4a50b382. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] Acquiring lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.network.neutron [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updating instance_info_cache with network_info: [{"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Releasing lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Instance network_info: |[{"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] Acquired lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Refreshing network info cache for port 3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Start _get_guest_xml network_info=[{"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:34:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1152148507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1152148507',id=1,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-g4ay9qdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:26Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=032de95e-98a7-411d-8726-5bf3a5c0ca49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:00:1a,bridge_name='br-int',has_traffic_filtering=True,id=3c33009f-d20a-4dd9-8e7a-134b4a50b382,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33009f-d2') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.objects.instance [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'pci_devices' on Instance uuid 032de95e-98a7-411d-8726-5bf3a5c0ca49 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:34:33 user nova-compute[75288]: INFO nova.compute.claims [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Claim successful on node user
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:34:33 user nova-compute[75288]:   <uuid>032de95e-98a7-411d-8726-5bf3a5c0ca49</uuid>
Nov 10 22:34:33 user nova-compute[75288]:   <name>instance-00000001</name>
Nov 10 22:34:33 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:34:33 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:34:33 user nova-compute[75288]:   <metadata>
Nov 10 22:34:33 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:34:33 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:34:33 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1152148507</nova:name>
Nov 10 22:34:33 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:34:33</nova:creationTime>
Nov 10 22:34:33 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:34:33 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:34:33 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:34:33 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:34:33 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:34:33 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:34:33 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:34:33 user nova-compute[75288]:       <nova:owner>
Nov 10 22:34:33 user nova-compute[75288]:         <nova:user uuid="07d1ae0425e64057b3b2220d4bb02624">tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member</nova:user>
Nov 10 22:34:33 user nova-compute[75288]:         <nova:project uuid="4325393aa3434c2a87912895d4574812">tempest-ServerBootFromVolumeStableRescueTest-244383607</nova:project>
Nov 10 22:34:33 user nova-compute[75288]:       </nova:owner>
Nov 10 22:34:33 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:34:33 user nova-compute[75288]:       <nova:ports>
Nov 10 22:34:33 user nova-compute[75288]:         <nova:port uuid="3c33009f-d20a-4dd9-8e7a-134b4a50b382">
Nov 10 22:34:33 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 22:34:33 user nova-compute[75288]:         </nova:port>
Nov 10 22:34:33 user nova-compute[75288]:       </nova:ports>
Nov 10 22:34:33 user nova-compute[75288]:     </nova:instance>
Nov 10 22:34:33 user nova-compute[75288]:   </metadata>
Nov 10 22:34:33 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:34:33 user nova-compute[75288]:     <system>
Nov 10 22:34:33 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:34:33 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:34:33 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:34:33 user nova-compute[75288]:       <entry name="serial">032de95e-98a7-411d-8726-5bf3a5c0ca49</entry>
Nov 10 22:34:33 user nova-compute[75288]:       <entry name="uuid">032de95e-98a7-411d-8726-5bf3a5c0ca49</entry>
Nov 10 22:34:33 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:34:33 user nova-compute[75288]:     </system>
Nov 10 22:34:33 user nova-compute[75288]:   </sysinfo>
Nov 10 22:34:33 user nova-compute[75288]:   <os>
Nov 10 22:34:33 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:34:33 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:34:33 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:34:33 user nova-compute[75288]:   </os>
Nov 10 22:34:33 user nova-compute[75288]:   <features>
Nov 10 22:34:33 user nova-compute[75288]:     <acpi/>
Nov 10 22:34:33 user nova-compute[75288]:     <apic/>
Nov 10 22:34:33 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:34:33 user nova-compute[75288]:   </features>
Nov 10 22:34:33 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:34:33 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:34:33 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:34:33 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:34:33 user nova-compute[75288]:   </clock>
Nov 10 22:34:33 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:34:33 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:34:33 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:34:33 user nova-compute[75288]:   </cpu>
Nov 10 22:34:33 user nova-compute[75288]:   <devices>
Nov 10 22:34:33 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:34:33 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:34:33 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk"/>
Nov 10 22:34:33 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:34:33 user nova-compute[75288]:     </disk>
Nov 10 22:34:33 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:34:33 user nova-compute[75288]:       <mac address="fa:16:3e:87:00:1a"/>
Nov 10 22:34:33 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:33 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:34:33 user nova-compute[75288]:       <target dev="tap3c33009f-d2"/>
Nov 10 22:34:33 user nova-compute[75288]:     </interface>
Nov 10 22:34:33 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:34:33 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/console.log" append="off"/>
Nov 10 22:34:33 user nova-compute[75288]:     </serial>
Nov 10 22:34:33 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:34:33 user nova-compute[75288]:     <video>
Nov 10 22:34:33 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:33 user nova-compute[75288]:     </video>
Nov 10 22:34:33 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:34:33 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:34:33 user nova-compute[75288]:     </rng>
Nov 10 22:34:33 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:34:33 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:34:33 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:34:33 user nova-compute[75288]:     </memballoon>
Nov 10 22:34:33 user nova-compute[75288]:   </devices>
Nov 10 22:34:33 user nova-compute[75288]: </domain>
Nov 10 22:34:33 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1152148507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1152148507',id=1,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-g4ay9qdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:26Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=032de95e-98a7-411d-8726-5bf3a5c0ca49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:00:1a,bridge_name='br-int',has_traffic_filtering=True,id=3c33009f-d20a-4dd9-8e7a-134b4a50b382,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33009f-d2') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:33 user nova-compute[75288]: DEBUG os_vif [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:00:1a,bridge_name='br-int',has_traffic_filtering=True,id=3c33009f-d20a-4dd9-8e7a-134b4a50b382,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33009f-d2') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Created schema index Interface.name {{(pid=75288) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Created schema index Port.name {{(pid=75288) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Created schema index Bridge.name {{(pid=75288) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [POLLOUT] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b61c846-bc8f-53a1-bb70-a3e69d8fb8e0', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:34 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmphh8du7sh/privsep.sock']
Nov 10 22:34:34 user sudo[84594]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmphh8du7sh/privsep.sock
Nov 10 22:34:34 user sudo[84594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:34:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.policy [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1839c7b8368947ccacf91af8fd6f0faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01027aba7e1424390b507afbad93f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:34:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Creating image(s)
Nov 10 22:34:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "/opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "/opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk 1073741824" returned: 0 in 0.050s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updated VIF entry in instance network info cache for port 3c33009f-d20a-4dd9-8e7a-134b4a50b382. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updating instance_info_cache with network_info: [{"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Successfully updated port: 8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71ca71cd-7821-44d6-91d3-8740b1515cfa req-0dac367a-52e1-4302-a627-a553f8c6367c service nova] Releasing lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:34:35 user nova-compute[75288]: INFO nova.compute.claims [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Claim successful on node user
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Cannot resize image /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Ensure instance console log exists: /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquired lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:34:35 user sudo[84594]: pam_unix(sudo:session): session closed for user root
Nov 10 22:34:35 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Spawned new privsep daemon via rootwrap
Nov 10 22:34:35 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 22:34:35 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 22:34:35 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 22:34:35 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84610
Nov 10 22:34:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Successfully created port: 0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received event network-changed-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Refreshing instance network info cache due to event network-changed-8f25dbf7-236c-48b3-ac45-5b4c9e285121. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] Acquiring lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c33009f-d2, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c33009f-d2, col_values=(('qos', UUID('af745d47-3502-41bc-8455-c1dc6257559d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c33009f-d2, col_values=(('external_ids', {'iface-id': '3c33009f-d20a-4dd9-8e7a-134b4a50b382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:00:1a', 'vm-uuid': '032de95e-98a7-411d-8726-5bf3a5c0ca49'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:36 user nova-compute[75288]: INFO os_vif [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:00:1a,bridge_name='br-int',has_traffic_filtering=True,id=3c33009f-d20a-4dd9-8e7a-134b4a50b382,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33009f-d2')
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No VIF found with MAC fa:16:3e:87:00:1a, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:34:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Successfully created port: b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.policy [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f6b930fa714405192e875eaf51cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bbf495a59c4f24945da89346c71dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:34:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Creating image(s)
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk 1073741824" returned: 0 in 0.043s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Updating instance_info_cache with network_info: [{"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Releasing lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Instance network_info: |[{"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] Acquired lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Refreshing network info cache for port 8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Start _get_guest_xml network_info=[{"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:34:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-591528331',display_name='tempest-DeleteServersTestJSON-server-591528331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-591528331',id=2,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebb5971c1a0740ed8c88bb3985e78ea1',ramdisk_id='',reservation_id='r-kckzpjgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-459072811',owner_user_name='tempest-DeleteServersTestJSON-459072811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:28Z,user_data=None,user_id='0b2cda6074654069b7a96c0b62c75834',uuid=36cfd3ac-5f27-45f6-9e6b-4581b22b533e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Converting VIF {"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ec:6e,bridge_name='br-int',has_traffic_filtering=True,id=8f25dbf7-236c-48b3-ac45-5b4c9e285121,network=Network(0be3a31f-08b2-4e2f-9357-b0ac701ffc3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f25dbf7-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lazy-loading 'pci_devices' on Instance uuid 36cfd3ac-5f27-45f6-9e6b-4581b22b533e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:34:37 user nova-compute[75288]:   <uuid>36cfd3ac-5f27-45f6-9e6b-4581b22b533e</uuid>
Nov 10 22:34:37 user nova-compute[75288]:   <name>instance-00000002</name>
Nov 10 22:34:37 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:34:37 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:34:37 user nova-compute[75288]:   <metadata>
Nov 10 22:34:37 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:34:37 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:34:37 user nova-compute[75288]:       <nova:name>tempest-DeleteServersTestJSON-server-591528331</nova:name>
Nov 10 22:34:37 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:34:37</nova:creationTime>
Nov 10 22:34:37 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:34:37 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:34:37 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:34:37 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:34:37 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:34:37 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:34:37 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:34:37 user nova-compute[75288]:       <nova:owner>
Nov 10 22:34:37 user nova-compute[75288]:         <nova:user uuid="0b2cda6074654069b7a96c0b62c75834">tempest-DeleteServersTestJSON-459072811-project-member</nova:user>
Nov 10 22:34:37 user nova-compute[75288]:         <nova:project uuid="ebb5971c1a0740ed8c88bb3985e78ea1">tempest-DeleteServersTestJSON-459072811</nova:project>
Nov 10 22:34:37 user nova-compute[75288]:       </nova:owner>
Nov 10 22:34:37 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:34:37 user nova-compute[75288]:       <nova:ports>
Nov 10 22:34:37 user nova-compute[75288]:         <nova:port uuid="8f25dbf7-236c-48b3-ac45-5b4c9e285121">
Nov 10 22:34:37 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 22:34:37 user nova-compute[75288]:         </nova:port>
Nov 10 22:34:37 user nova-compute[75288]:       </nova:ports>
Nov 10 22:34:37 user nova-compute[75288]:     </nova:instance>
Nov 10 22:34:37 user nova-compute[75288]:   </metadata>
Nov 10 22:34:37 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:34:37 user nova-compute[75288]:     <system>
Nov 10 22:34:37 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:34:37 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:34:37 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:34:37 user nova-compute[75288]:       <entry name="serial">36cfd3ac-5f27-45f6-9e6b-4581b22b533e</entry>
Nov 10 22:34:37 user nova-compute[75288]:       <entry name="uuid">36cfd3ac-5f27-45f6-9e6b-4581b22b533e</entry>
Nov 10 22:34:37 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:34:37 user nova-compute[75288]:     </system>
Nov 10 22:34:37 user nova-compute[75288]:   </sysinfo>
Nov 10 22:34:37 user nova-compute[75288]:   <os>
Nov 10 22:34:37 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:34:37 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:34:37 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:34:37 user nova-compute[75288]:   </os>
Nov 10 22:34:37 user nova-compute[75288]:   <features>
Nov 10 22:34:37 user nova-compute[75288]:     <acpi/>
Nov 10 22:34:37 user nova-compute[75288]:     <apic/>
Nov 10 22:34:37 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:34:37 user nova-compute[75288]:   </features>
Nov 10 22:34:37 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:34:37 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:34:37 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:34:37 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:34:37 user nova-compute[75288]:   </clock>
Nov 10 22:34:37 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:34:37 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:34:37 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:34:37 user nova-compute[75288]:   </cpu>
Nov 10 22:34:37 user nova-compute[75288]:   <devices>
Nov 10 22:34:37 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:34:37 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:34:37 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk"/>
Nov 10 22:34:37 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:34:37 user nova-compute[75288]:     </disk>
Nov 10 22:34:37 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:34:37 user nova-compute[75288]:       <mac address="fa:16:3e:b6:ec:6e"/>
Nov 10 22:34:37 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:37 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:34:37 user nova-compute[75288]:       <target dev="tap8f25dbf7-23"/>
Nov 10 22:34:37 user nova-compute[75288]:     </interface>
Nov 10 22:34:37 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:34:37 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/console.log" append="off"/>
Nov 10 22:34:37 user nova-compute[75288]:     </serial>
Nov 10 22:34:37 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:34:37 user nova-compute[75288]:     <video>
Nov 10 22:34:37 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:37 user nova-compute[75288]:     </video>
Nov 10 22:34:37 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:34:37 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:34:37 user nova-compute[75288]:     </rng>
Nov 10 22:34:37 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:34:37 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:34:37 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:34:37 user nova-compute[75288]:     </memballoon>
Nov 10 22:34:37 user nova-compute[75288]:   </devices>
Nov 10 22:34:37 user nova-compute[75288]: </domain>
Nov 10 22:34:37 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-591528331',display_name='tempest-DeleteServersTestJSON-server-591528331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-591528331',id=2,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebb5971c1a0740ed8c88bb3985e78ea1',ramdisk_id='',reservation_id='r-kckzpjgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-459072811',owner_user_name='tempest-DeleteServersTestJSON-459072811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:28Z,user_data=None,user_id='0b2cda6074654069b7a96c0b62c75834',uuid=36cfd3ac-5f27-45f6-9e6b-4581b22b533e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Converting VIF {"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ec:6e,bridge_name='br-int',has_traffic_filtering=True,id=8f25dbf7-236c-48b3-ac45-5b4c9e285121,network=Network(0be3a31f-08b2-4e2f-9357-b0ac701ffc3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f25dbf7-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG os_vif [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ec:6e,bridge_name='br-int',has_traffic_filtering=True,id=8f25dbf7-236c-48b3-ac45-5b4c9e285121,network=Network(0be3a31f-08b2-4e2f-9357-b0ac701ffc3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f25dbf7-23') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22022414-39eb-5648-b555-b00a42a0d285', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f25dbf7-23, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f25dbf7-23, col_values=(('qos', UUID('633039b4-a873-40d7-9b9e-23dea0f3641d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f25dbf7-23, col_values=(('external_ids', {'iface-id': '8f25dbf7-236c-48b3-ac45-5b4c9e285121', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ec:6e', 'vm-uuid': '36cfd3ac-5f27-45f6-9e6b-4581b22b533e'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: INFO os_vif [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ec:6e,bridge_name='br-int',has_traffic_filtering=True,id=8f25dbf7-236c-48b3-ac45-5b4c9e285121,network=Network(0be3a31f-08b2-4e2f-9357-b0ac701ffc3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f25dbf7-23')
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Cannot resize image /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Ensure instance console log exists: /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] No VIF found with MAC fa:16:3e:b6:ec:6e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Successfully updated port: b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:34:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:34:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-changed-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Refreshing instance network info cache due to event network-changed-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:34:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Successfully created port: a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Instance network_info: |[{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Refreshing network info cache for port b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Start _get_guest_xml network_info=[{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:34:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1387018457',display_name='tempest-ServerActionsTestOtherA-server-1387018457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1387018457',id=4,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ujuj0lyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=5f06057c-abec-4ae3-ac9e-2cdede2cad3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6e:67,bridge_name='br-int',has_traffic_filtering=True,id=b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66bbdfb-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f06057c-abec-4ae3-ac9e-2cdede2cad3f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:34:39 user nova-compute[75288]:   <uuid>5f06057c-abec-4ae3-ac9e-2cdede2cad3f</uuid>
Nov 10 22:34:39 user nova-compute[75288]:   <name>instance-00000004</name>
Nov 10 22:34:39 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:34:39 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:34:39 user nova-compute[75288]:   <metadata>
Nov 10 22:34:39 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:34:39 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:34:39 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-1387018457</nova:name>
Nov 10 22:34:39 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:34:39</nova:creationTime>
Nov 10 22:34:39 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:34:39 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:34:39 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:34:39 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:34:39 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:34:39 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:34:39 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:34:39 user nova-compute[75288]:       <nova:owner>
Nov 10 22:34:39 user nova-compute[75288]:         <nova:user uuid="1839c7b8368947ccacf91af8fd6f0faf">tempest-ServerActionsTestOtherA-1568173136-project-member</nova:user>
Nov 10 22:34:39 user nova-compute[75288]:         <nova:project uuid="d01027aba7e1424390b507afbad93f23">tempest-ServerActionsTestOtherA-1568173136</nova:project>
Nov 10 22:34:39 user nova-compute[75288]:       </nova:owner>
Nov 10 22:34:39 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:34:39 user nova-compute[75288]:       <nova:ports>
Nov 10 22:34:39 user nova-compute[75288]:         <nova:port uuid="b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0">
Nov 10 22:34:39 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 22:34:39 user nova-compute[75288]:         </nova:port>
Nov 10 22:34:39 user nova-compute[75288]:       </nova:ports>
Nov 10 22:34:39 user nova-compute[75288]:     </nova:instance>
Nov 10 22:34:39 user nova-compute[75288]:   </metadata>
Nov 10 22:34:39 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:34:39 user nova-compute[75288]:     <system>
Nov 10 22:34:39 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:34:39 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:34:39 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:34:39 user nova-compute[75288]:       <entry name="serial">5f06057c-abec-4ae3-ac9e-2cdede2cad3f</entry>
Nov 10 22:34:39 user nova-compute[75288]:       <entry name="uuid">5f06057c-abec-4ae3-ac9e-2cdede2cad3f</entry>
Nov 10 22:34:39 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:34:39 user nova-compute[75288]:     </system>
Nov 10 22:34:39 user nova-compute[75288]:   </sysinfo>
Nov 10 22:34:39 user nova-compute[75288]:   <os>
Nov 10 22:34:39 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:34:39 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:34:39 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:34:39 user nova-compute[75288]:   </os>
Nov 10 22:34:39 user nova-compute[75288]:   <features>
Nov 10 22:34:39 user nova-compute[75288]:     <acpi/>
Nov 10 22:34:39 user nova-compute[75288]:     <apic/>
Nov 10 22:34:39 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:34:39 user nova-compute[75288]:   </features>
Nov 10 22:34:39 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:34:39 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:34:39 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:34:39 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:34:39 user nova-compute[75288]:   </clock>
Nov 10 22:34:39 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:34:39 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:34:39 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:34:39 user nova-compute[75288]:   </cpu>
Nov 10 22:34:39 user nova-compute[75288]:   <devices>
Nov 10 22:34:39 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:34:39 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:34:39 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk"/>
Nov 10 22:34:39 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:34:39 user nova-compute[75288]:     </disk>
Nov 10 22:34:39 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:34:39 user nova-compute[75288]:       <mac address="fa:16:3e:6d:6e:67"/>
Nov 10 22:34:39 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:39 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:34:39 user nova-compute[75288]:       <target dev="tapb66bbdfb-8c"/>
Nov 10 22:34:39 user nova-compute[75288]:     </interface>
Nov 10 22:34:39 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:34:39 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/console.log" append="off"/>
Nov 10 22:34:39 user nova-compute[75288]:     </serial>
Nov 10 22:34:39 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:34:39 user nova-compute[75288]:     <video>
Nov 10 22:34:39 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:39 user nova-compute[75288]:     </video>
Nov 10 22:34:39 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:34:39 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:34:39 user nova-compute[75288]:     </rng>
Nov 10 22:34:39 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:34:39 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:34:39 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:34:39 user nova-compute[75288]:     </memballoon>
Nov 10 22:34:39 user nova-compute[75288]:   </devices>
Nov 10 22:34:39 user nova-compute[75288]: </domain>
Nov 10 22:34:39 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1387018457',display_name='tempest-ServerActionsTestOtherA-server-1387018457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1387018457',id=4,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ujuj0lyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=5f06057c-abec-4ae3-ac9e-2cdede2cad3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6e:67,bridge_name='br-int',has_traffic_filtering=True,id=b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66bbdfb-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG os_vif [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6e:67,bridge_name='br-int',has_traffic_filtering=True,id=b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66bbdfb-8c') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13d2c64c-a586-50d4-8875-3809e20f710b', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb66bbdfb-8c, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb66bbdfb-8c, col_values=(('qos', UUID('1e2e67a4-3737-4071-b491-ed2ad353450d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb66bbdfb-8c, col_values=(('external_ids', {'iface-id': 'b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:6e:67', 'vm-uuid': '5f06057c-abec-4ae3-ac9e-2cdede2cad3f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: INFO os_vif [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6e:67,bridge_name='br-int',has_traffic_filtering=True,id=b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66bbdfb-8c')
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No VIF found with MAC fa:16:3e:6d:6e:67, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Updated VIF entry in instance network info cache for port 8f25dbf7-236c-48b3-ac45-5b4c9e285121. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Updating instance_info_cache with network_info: [{"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9df99df-054f-4e50-8ecf-0d03b1544247 req-ad3d404c-40bf-4a68-bb44-2f24b4222609 service nova] Releasing lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Successfully updated port: 0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquired lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing instance network info cache due to event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] Acquiring lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updated VIF entry in instance network info cache for port b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73f34c37-20df-4b7e-8815-bbe3881c6fee req-e8ccb3fa-93d4-463d-bd8b-cedace23942b service nova] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Successfully updated port: a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquired lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-changed-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Refreshing instance network info cache due to event network-changed-a17af079-be58-40cc-a993-4d5304f20445. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] Acquiring lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Releasing lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance network_info: |[{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] Acquired lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Start _get_guest_xml network_info=[{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:34:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-629412587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-629412587',id=3,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsn8RWoTM33U1Wn0XsXWYmBTav3JNsALpJyij1IuoeHWuaRZv8F9nZwHxJycfYTGcA1LdY/Ync7tOpUMY/NKULD8AnmpUADEYZqDSbY5SSjQyoO/dCs/0YMw11L2zKauQ==',key_name='tempest-keypair-864991346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-qnxqgmhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=a1701e0c-f9c9-4ba8-81ec-1b9966e033a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'pci_devices' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:34:41 user nova-compute[75288]:   <uuid>a1701e0c-f9c9-4ba8-81ec-1b9966e033a3</uuid>
Nov 10 22:34:41 user nova-compute[75288]:   <name>instance-00000003</name>
Nov 10 22:34:41 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:34:41 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:34:41 user nova-compute[75288]:   <metadata>
Nov 10 22:34:41 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:34:41 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-629412587</nova:name>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:34:41</nova:creationTime>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:34:41 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:34:41 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:owner>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:user uuid="05f170ae42004d57abea1bf318d05dab">tempest-AttachVolumeShelveTestJSON-1618351090-project-member</nova:user>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:project uuid="53f6c30d0f1a467f8e977a73463e2d1e">tempest-AttachVolumeShelveTestJSON-1618351090</nova:project>
Nov 10 22:34:41 user nova-compute[75288]:       </nova:owner>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:ports>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:port uuid="0404036a-dd85-4ebb-9d1d-4728ae7270ed">
Nov 10 22:34:41 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 22:34:41 user nova-compute[75288]:         </nova:port>
Nov 10 22:34:41 user nova-compute[75288]:       </nova:ports>
Nov 10 22:34:41 user nova-compute[75288]:     </nova:instance>
Nov 10 22:34:41 user nova-compute[75288]:   </metadata>
Nov 10 22:34:41 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:34:41 user nova-compute[75288]:     <system>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="serial">a1701e0c-f9c9-4ba8-81ec-1b9966e033a3</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="uuid">a1701e0c-f9c9-4ba8-81ec-1b9966e033a3</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:34:41 user nova-compute[75288]:     </system>
Nov 10 22:34:41 user nova-compute[75288]:   </sysinfo>
Nov 10 22:34:41 user nova-compute[75288]:   <os>
Nov 10 22:34:41 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:34:41 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:34:41 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:34:41 user nova-compute[75288]:   </os>
Nov 10 22:34:41 user nova-compute[75288]:   <features>
Nov 10 22:34:41 user nova-compute[75288]:     <acpi/>
Nov 10 22:34:41 user nova-compute[75288]:     <apic/>
Nov 10 22:34:41 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:34:41 user nova-compute[75288]:   </features>
Nov 10 22:34:41 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:34:41 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:34:41 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:34:41 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:34:41 user nova-compute[75288]:   </clock>
Nov 10 22:34:41 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:34:41 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:34:41 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:34:41 user nova-compute[75288]:   </cpu>
Nov 10 22:34:41 user nova-compute[75288]:   <devices>
Nov 10 22:34:41 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:34:41 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:34:41 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk"/>
Nov 10 22:34:41 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:34:41 user nova-compute[75288]:     </disk>
Nov 10 22:34:41 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:34:41 user nova-compute[75288]:       <mac address="fa:16:3e:8b:e8:23"/>
Nov 10 22:34:41 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:41 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:34:41 user nova-compute[75288]:       <target dev="tap0404036a-dd"/>
Nov 10 22:34:41 user nova-compute[75288]:     </interface>
Nov 10 22:34:41 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:34:41 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/console.log" append="off"/>
Nov 10 22:34:41 user nova-compute[75288]:     </serial>
Nov 10 22:34:41 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:34:41 user nova-compute[75288]:     <video>
Nov 10 22:34:41 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:41 user nova-compute[75288]:     </video>
Nov 10 22:34:41 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:34:41 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:34:41 user nova-compute[75288]:     </rng>
Nov 10 22:34:41 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:34:41 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:34:41 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:34:41 user nova-compute[75288]:     </memballoon>
Nov 10 22:34:41 user nova-compute[75288]:   </devices>
Nov 10 22:34:41 user nova-compute[75288]: </domain>
Nov 10 22:34:41 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-629412587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-629412587',id=3,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsn8RWoTM33U1Wn0XsXWYmBTav3JNsALpJyij1IuoeHWuaRZv8F9nZwHxJycfYTGcA1LdY/Ync7tOpUMY/NKULD8AnmpUADEYZqDSbY5SSjQyoO/dCs/0YMw11L2zKauQ==',key_name='tempest-keypair-864991346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-qnxqgmhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=a1701e0c-f9c9-4ba8-81ec-1b9966e033a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG os_vif [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '593b81d7-8739-5d74-ab54-60ac628681f9', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Releasing lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance network_info: |[{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] Acquired lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Refreshing network info cache for port a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Start _get_guest_xml network_info=[{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0404036a-dd, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0404036a-dd, col_values=(('qos', UUID('1f308b34-2560-4116-960e-9b4183704e3b')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0404036a-dd, col_values=(('external_ids', {'iface-id': '0404036a-dd85-4ebb-9d1d-4728ae7270ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:e8:23', 'vm-uuid': 'a1701e0c-f9c9-4ba8-81ec-1b9966e033a3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: INFO os_vif [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd')
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'pci_devices' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:34:41 user nova-compute[75288]:   <uuid>33ebbf72-0319-4e06-af0c-cf1462053666</uuid>
Nov 10 22:34:41 user nova-compute[75288]:   <name>instance-00000005</name>
Nov 10 22:34:41 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:34:41 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:34:41 user nova-compute[75288]:   <metadata>
Nov 10 22:34:41 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:34:41 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-1953048792</nova:name>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:34:41</nova:creationTime>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:34:41 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:34:41 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:owner>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:user uuid="7f6b930fa714405192e875eaf51cff95">tempest-AttachVolumeTestJSON-979908124-project-member</nova:user>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:project uuid="28bbf495a59c4f24945da89346c71dff">tempest-AttachVolumeTestJSON-979908124</nova:project>
Nov 10 22:34:41 user nova-compute[75288]:       </nova:owner>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:34:41 user nova-compute[75288]:       <nova:ports>
Nov 10 22:34:41 user nova-compute[75288]:         <nova:port uuid="a17af079-be58-40cc-a993-4d5304f20445">
Nov 10 22:34:41 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 22:34:41 user nova-compute[75288]:         </nova:port>
Nov 10 22:34:41 user nova-compute[75288]:       </nova:ports>
Nov 10 22:34:41 user nova-compute[75288]:     </nova:instance>
Nov 10 22:34:41 user nova-compute[75288]:   </metadata>
Nov 10 22:34:41 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:34:41 user nova-compute[75288]:     <system>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="serial">33ebbf72-0319-4e06-af0c-cf1462053666</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="uuid">33ebbf72-0319-4e06-af0c-cf1462053666</entry>
Nov 10 22:34:41 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:34:41 user nova-compute[75288]:     </system>
Nov 10 22:34:41 user nova-compute[75288]:   </sysinfo>
Nov 10 22:34:41 user nova-compute[75288]:   <os>
Nov 10 22:34:41 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:34:41 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:34:41 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:34:41 user nova-compute[75288]:   </os>
Nov 10 22:34:41 user nova-compute[75288]:   <features>
Nov 10 22:34:41 user nova-compute[75288]:     <acpi/>
Nov 10 22:34:41 user nova-compute[75288]:     <apic/>
Nov 10 22:34:41 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:34:41 user nova-compute[75288]:   </features>
Nov 10 22:34:41 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:34:41 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:34:41 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:34:41 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:34:41 user nova-compute[75288]:   </clock>
Nov 10 22:34:41 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:34:41 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:34:41 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:34:41 user nova-compute[75288]:   </cpu>
Nov 10 22:34:41 user nova-compute[75288]:   <devices>
Nov 10 22:34:41 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:34:41 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:34:41 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk"/>
Nov 10 22:34:41 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:34:41 user nova-compute[75288]:     </disk>
Nov 10 22:34:41 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:34:41 user nova-compute[75288]:       <mac address="fa:16:3e:36:3b:c0"/>
Nov 10 22:34:41 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:41 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:34:41 user nova-compute[75288]:       <target dev="tapa17af079-be"/>
Nov 10 22:34:41 user nova-compute[75288]:     </interface>
Nov 10 22:34:41 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:34:41 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/console.log" append="off"/>
Nov 10 22:34:41 user nova-compute[75288]:     </serial>
Nov 10 22:34:41 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:34:41 user nova-compute[75288]:     <video>
Nov 10 22:34:41 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:41 user nova-compute[75288]:     </video>
Nov 10 22:34:41 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:34:41 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:34:41 user nova-compute[75288]:     </rng>
Nov 10 22:34:41 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:34:41 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:34:41 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:34:41 user nova-compute[75288]:     </memballoon>
Nov 10 22:34:41 user nova-compute[75288]:   </devices>
Nov 10 22:34:41 user nova-compute[75288]: </domain>
Nov 10 22:34:41 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG os_vif [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd35169cb-7222-504a-b243-b4639ef0aa0e', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa17af079-be, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa17af079-be, col_values=(('qos', UUID('68eafede-f72d-4f3a-8727-b9aa1d416720')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa17af079-be, col_values=(('external_ids', {'iface-id': 'a17af079-be58-40cc-a993-4d5304f20445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:3b:c0', 'vm-uuid': '33ebbf72-0319-4e06-af0c-cf1462053666'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:41 user nova-compute[75288]: INFO os_vif [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be')
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No VIF found with MAC fa:16:3e:8b:e8:23, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No VIF found with MAC fa:16:3e:36:3b:c0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updated VIF entry in instance network info cache for port a17af079-be58-40cc-a993-4d5304f20445. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5b6f7d7-7cb8-4c96-9962-7ae5677d5ab9 req-604d7518-65ee-4928-89ec-9f2af78fec70 service nova] Releasing lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:34:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Instance spawned successfully.
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:42 user nova-compute[75288]: INFO nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Took 15.96 seconds to spawn the instance on the hypervisor.
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:34:42 user nova-compute[75288]: INFO nova.compute.manager [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Took 17.22 seconds to build instance.
Nov 10 22:34:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-97cc714c-4fb5-4a1b-b7e6-6781f28d1a6e tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.450s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updated VIF entry in instance network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-494daadc-9a94-430f-baeb-bb196d395370 req-263d2d48-0799-4aad-bf91-2bfda8d4882d service nova] Releasing lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:34:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Instance spawned successfully.
Nov 10 22:34:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:34:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:43 user nova-compute[75288]: INFO nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Took 14.69 seconds to spawn the instance on the hypervisor.
Nov 10 22:34:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:34:43 user nova-compute[75288]: INFO nova.compute.manager [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Took 15.52 seconds to build instance.
Nov 10 22:34:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf1ce362-a1a6-450e-b0d8-1dad8b50b372 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.738s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Instance spawned successfully.
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:34:46 user nova-compute[75288]: INFO nova.compute.claims [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Claim successful on node user
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:46 user nova-compute[75288]: INFO nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Took 11.75 seconds to spawn the instance on the hypervisor.
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:34:46 user nova-compute[75288]: INFO nova.compute.manager [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Took 12.85 seconds to build instance.
Nov 10 22:34:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d234c082-7f74-41eb-9848-348e19d6a981 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.989s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:34:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 22:34:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG nova.policy [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ef514f184d416192ea5c6ce23e476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49a6f48188d42f395db22e590f1f17b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:34:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Creating image(s)
Nov 10 22:34:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "/opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "/opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "/opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "71104f00a1bc629791b256fc0807ba916caa074c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "71104f00a1bc629791b256fc0807ba916caa074c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:34:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance spawned successfully.
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:34:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance spawned successfully.
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.part --force-share --output=json" returned: 0 in 0.456s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.virt.images [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] 8918b081-30d4-479f-9cc7-c2e6b4411e30 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.part /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:48 user nova-compute[75288]: INFO nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Took 17.40 seconds to spawn the instance on the hypervisor.
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:34:48 user nova-compute[75288]: INFO nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Took 12.34 seconds to spawn the instance on the hypervisor.
Nov 10 22:34:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.part /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.converted" returned: 0 in 0.369s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:49 user nova-compute[75288]: INFO nova.compute.manager [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Took 18.25 seconds to build instance.
Nov 10 22:34:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:34:49 user nova-compute[75288]: INFO nova.compute.claims [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Claim successful on node user
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cb6ccac6-c9f1-478f-b973-79210cedde9f tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.448s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:49 user nova-compute[75288]: INFO nova.compute.manager [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Took 13.71 seconds to build instance.
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c.converted --force-share --output=json" returned: 0 in 0.372s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "71104f00a1bc629791b256fc0807ba916caa074c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.865s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6df187a8-d4be-487a-b9c8-3e2d7bae477e tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.866s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c --force-share --output=json" returned: 0 in 0.304s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "71104f00a1bc629791b256fc0807ba916caa074c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "71104f00a1bc629791b256fc0807ba916caa074c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.896s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c --force-share --output=json" returned: 0 in 0.317s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c,backing_fmt=raw /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c,backing_fmt=raw /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk 1073741824" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "71104f00a1bc629791b256fc0807ba916caa074c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.532s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:34:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c --force-share --output=json" returned: 0 in 0.267s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.policy [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe464c9138840019ac3a32c3c9bcfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ddead166794fd4b660457f109f7bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Successfully created port: 1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:34:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Creating image(s)
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "/opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "/opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "/opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.387s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Cannot resize image /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Ensure instance console log exists: /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.254s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.293s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk 1073741824" returned: 0 in 0.069s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.310s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:34:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Cannot resize image /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Ensure instance console log exists: /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Successfully created port: 56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-acdc20ef-5484-4e15-bb8e-2c4a8e8599de req-c00c5657-ec6f-4fd0-803e-51f5dbf208d3 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received event network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acdc20ef-5484-4e15-bb8e-2c4a8e8599de req-c00c5657-ec6f-4fd0-803e-51f5dbf208d3 service nova] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acdc20ef-5484-4e15-bb8e-2c4a8e8599de req-c00c5657-ec6f-4fd0-803e-51f5dbf208d3 service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acdc20ef-5484-4e15-bb8e-2c4a8e8599de req-c00c5657-ec6f-4fd0-803e-51f5dbf208d3 service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-acdc20ef-5484-4e15-bb8e-2c4a8e8599de req-c00c5657-ec6f-4fd0-803e-51f5dbf208d3 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] No waiting events found dispatching network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:34:52 user nova-compute[75288]: WARNING nova.compute.manager [req-acdc20ef-5484-4e15-bb8e-2c4a8e8599de req-c00c5657-ec6f-4fd0-803e-51f5dbf208d3 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received unexpected event network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 for instance with vm_state active and task_state None.
Nov 10 22:34:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Successfully updated port: 56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Successfully updated port: 1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquired lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquired lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-changed-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Refreshing instance network info cache due to event network-changed-1b3b08c2-56ad-41fe-b4f9-80f63d87641f. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] Acquiring lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-changed-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Refreshing instance network info cache due to event network-changed-56cdebbe-eb68-4d33-a733-a4af22ec7369. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] Acquiring lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updating instance_info_cache with network_info: [{"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Releasing lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Instance network_info: |[{"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] Acquired lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Refreshing network info cache for port 1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Start _get_guest_xml network_info=[{"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:34:39Z,direct_url=<?>,disk_format='qcow2',id=8918b081-30d4-479f-9cc7-c2e6b4411e30,min_disk=0,min_ram=0,name='',owner='2e7e0866d6bc4243bb7f1a5e53252c7a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:34:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/sda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': '8918b081-30d4-479f-9cc7-c2e6b4411e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:34:53 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:53 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:34:39Z,direct_url=<?>,disk_format='qcow2',id=8918b081-30d4-479f-9cc7-c2e6b4411e30,min_disk=0,min_ram=0,name='',owner='2e7e0866d6bc4243bb7f1a5e53252c7a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:34:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-191786997',display_name='tempest-AttachSCSIVolumeTestJSON-server-191786997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-191786997',id=6,image_ref='8918b081-30d4-479f-9cc7-c2e6b4411e30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmtrlRmmb8ffCSyXbIY8mxc1bqvWnSI7BoXiP10OGMDVb4AVqpQq3tTbaJKeTrN3JLnLegeM5PK8x74DkR0B67t7vKXIOgAa7SH7YgZCD/WhedNjuaew5xJfLKK5KXwvA==',key_name='tempest-keypair-2086273440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49a6f48188d42f395db22e590f1f17b',ramdisk_id='',reservation_id='r-5y6p04fx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8918b081-30d4-479f-9cc7-c2e6b4411e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-795028462',owner_user_name='tempest-AttachSCSIVolumeTestJSON-795028462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ef514f184d416192ea5c6ce23e476f',uuid=7668df42-4bbb-4913-97e7-3b4b67f94eb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Converting VIF {"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:70:e2,bridge_name='br-int',has_traffic_filtering=True,id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f,network=Network(d4bcd532-53bb-42e7-a2b6-f76841b40ba9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3b08c2-56') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lazy-loading 'pci_devices' on Instance uuid 7668df42-4bbb-4913-97e7-3b4b67f94eb1 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:34:54 user nova-compute[75288]:   <uuid>7668df42-4bbb-4913-97e7-3b4b67f94eb1</uuid>
Nov 10 22:34:54 user nova-compute[75288]:   <name>instance-00000006</name>
Nov 10 22:34:54 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:34:54 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:34:54 user nova-compute[75288]:   <metadata>
Nov 10 22:34:54 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:34:54 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-191786997</nova:name>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:34:53</nova:creationTime>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:34:54 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:34:54 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:owner>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:user uuid="39ef514f184d416192ea5c6ce23e476f">tempest-AttachSCSIVolumeTestJSON-795028462-project-member</nova:user>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:project uuid="c49a6f48188d42f395db22e590f1f17b">tempest-AttachSCSIVolumeTestJSON-795028462</nova:project>
Nov 10 22:34:54 user nova-compute[75288]:       </nova:owner>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:root type="image" uuid="8918b081-30d4-479f-9cc7-c2e6b4411e30"/>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:ports>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:port uuid="1b3b08c2-56ad-41fe-b4f9-80f63d87641f">
Nov 10 22:34:54 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 22:34:54 user nova-compute[75288]:         </nova:port>
Nov 10 22:34:54 user nova-compute[75288]:       </nova:ports>
Nov 10 22:34:54 user nova-compute[75288]:     </nova:instance>
Nov 10 22:34:54 user nova-compute[75288]:   </metadata>
Nov 10 22:34:54 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:34:54 user nova-compute[75288]:     <system>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="serial">7668df42-4bbb-4913-97e7-3b4b67f94eb1</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="uuid">7668df42-4bbb-4913-97e7-3b4b67f94eb1</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:34:54 user nova-compute[75288]:     </system>
Nov 10 22:34:54 user nova-compute[75288]:   </sysinfo>
Nov 10 22:34:54 user nova-compute[75288]:   <os>
Nov 10 22:34:54 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:34:54 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:34:54 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:34:54 user nova-compute[75288]:   </os>
Nov 10 22:34:54 user nova-compute[75288]:   <features>
Nov 10 22:34:54 user nova-compute[75288]:     <acpi/>
Nov 10 22:34:54 user nova-compute[75288]:     <apic/>
Nov 10 22:34:54 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:34:54 user nova-compute[75288]:   </features>
Nov 10 22:34:54 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:34:54 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:34:54 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:34:54 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:34:54 user nova-compute[75288]:   </clock>
Nov 10 22:34:54 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:34:54 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:34:54 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:34:54 user nova-compute[75288]:   </cpu>
Nov 10 22:34:54 user nova-compute[75288]:   <devices>
Nov 10 22:34:54 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:34:54 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:34:54 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk"/>
Nov 10 22:34:54 user nova-compute[75288]:       <target dev="sda" bus="scsi"/>
Nov 10 22:34:54 user nova-compute[75288]:       <address type="drive" controller="0" unit="0"/>
Nov 10 22:34:54 user nova-compute[75288]:     </disk>
Nov 10 22:34:54 user nova-compute[75288]:     <disk type="file" device="cdrom">
Nov 10 22:34:54 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 22:34:54 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk.config"/>
Nov 10 22:34:54 user nova-compute[75288]:       <target dev="sdb" bus="scsi"/>
Nov 10 22:34:54 user nova-compute[75288]:       <address type="drive" controller="0" unit="1"/>
Nov 10 22:34:54 user nova-compute[75288]:     </disk>
Nov 10 22:34:54 user nova-compute[75288]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 22:34:54 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:34:54 user nova-compute[75288]:       <mac address="fa:16:3e:cd:70:e2"/>
Nov 10 22:34:54 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:54 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:34:54 user nova-compute[75288]:       <target dev="tap1b3b08c2-56"/>
Nov 10 22:34:54 user nova-compute[75288]:     </interface>
Nov 10 22:34:54 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:34:54 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/console.log" append="off"/>
Nov 10 22:34:54 user nova-compute[75288]:     </serial>
Nov 10 22:34:54 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:34:54 user nova-compute[75288]:     <video>
Nov 10 22:34:54 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:54 user nova-compute[75288]:     </video>
Nov 10 22:34:54 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:34:54 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:34:54 user nova-compute[75288]:     </rng>
Nov 10 22:34:54 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:34:54 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:34:54 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:34:54 user nova-compute[75288]:     </memballoon>
Nov 10 22:34:54 user nova-compute[75288]:   </devices>
Nov 10 22:34:54 user nova-compute[75288]: </domain>
Nov 10 22:34:54 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-191786997',display_name='tempest-AttachSCSIVolumeTestJSON-server-191786997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-191786997',id=6,image_ref='8918b081-30d4-479f-9cc7-c2e6b4411e30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmtrlRmmb8ffCSyXbIY8mxc1bqvWnSI7BoXiP10OGMDVb4AVqpQq3tTbaJKeTrN3JLnLegeM5PK8x74DkR0B67t7vKXIOgAa7SH7YgZCD/WhedNjuaew5xJfLKK5KXwvA==',key_name='tempest-keypair-2086273440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49a6f48188d42f395db22e590f1f17b',ramdisk_id='',reservation_id='r-5y6p04fx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8918b081-30d4-479f-9cc7-c2e6b4411e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-795028462',owner_user_name='tempest-AttachSCSIVolumeTestJSON-795028462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ef514f184d416192ea5c6ce23e476f',uuid=7668df42-4bbb-4913-97e7-3b4b67f94eb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Converting VIF {"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:70:e2,bridge_name='br-int',has_traffic_filtering=True,id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f,network=Network(d4bcd532-53bb-42e7-a2b6-f76841b40ba9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3b08c2-56') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG os_vif [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:70:e2,bridge_name='br-int',has_traffic_filtering=True,id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f,network=Network(d4bcd532-53bb-42e7-a2b6-f76841b40ba9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3b08c2-56') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70627db0-d384-55ba-8946-02defb1d92be', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b3b08c2-56, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b3b08c2-56, col_values=(('qos', UUID('5bf0b93c-7fc3-4689-b7da-ff554d7f5755')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b3b08c2-56, col_values=(('external_ids', {'iface-id': '1b3b08c2-56ad-41fe-b4f9-80f63d87641f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:70:e2', 'vm-uuid': '7668df42-4bbb-4913-97e7-3b4b67f94eb1'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:54 user nova-compute[75288]: INFO os_vif [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:70:e2,bridge_name='br-int',has_traffic_filtering=True,id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f,network=Network(d4bcd532-53bb-42e7-a2b6-f76841b40ba9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3b08c2-56')
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updating instance_info_cache with network_info: [{"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Releasing lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Instance network_info: |[{"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] Acquired lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Refreshing network info cache for port 56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Start _get_guest_xml network_info=[{"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] No BDM found with device name sda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] No VIF found with MAC fa:16:3e:cd:70:e2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:34:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Using config drive
Nov 10 22:34:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1709310066',display_name='tempest-VolumesAdminNegativeTest-server-1709310066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1709310066',id=7,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARaNJ2Q85Dq6STMwQ2qAyc+61Bi+oImbfRX6UEkYjPouffmPHIZOVfyyaRKvIJU2GToL16dOH0wObruYZfH0ILro1rtijf5ZIafH9UcXTXq9JJeugyyRx4da1jpL8zXXA==',key_name='tempest-keypair-1168477474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ddead166794fd4b660457f109f7bc3',ramdisk_id='',reservation_id='r-4k0sollv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1375484400',owner_user_name='tempest-VolumesAdminNegativeTest-1375484400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe464c9138840019ac3a32c3c9bcfab',uuid=80788251-eb95-4022-8170-d219f083c64f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converting VIF {"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:65:5d,bridge_name='br-int',has_traffic_filtering=True,id=56cdebbe-eb68-4d33-a733-a4af22ec7369,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cdebbe-eb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lazy-loading 'pci_devices' on Instance uuid 80788251-eb95-4022-8170-d219f083c64f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:34:54 user nova-compute[75288]:   <uuid>80788251-eb95-4022-8170-d219f083c64f</uuid>
Nov 10 22:34:54 user nova-compute[75288]:   <name>instance-00000007</name>
Nov 10 22:34:54 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:34:54 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:34:54 user nova-compute[75288]:   <metadata>
Nov 10 22:34:54 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:34:54 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1709310066</nova:name>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:34:54</nova:creationTime>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:34:54 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:34:54 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:owner>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:user uuid="8fe464c9138840019ac3a32c3c9bcfab">tempest-VolumesAdminNegativeTest-1375484400-project-member</nova:user>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:project uuid="70ddead166794fd4b660457f109f7bc3">tempest-VolumesAdminNegativeTest-1375484400</nova:project>
Nov 10 22:34:54 user nova-compute[75288]:       </nova:owner>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:34:54 user nova-compute[75288]:       <nova:ports>
Nov 10 22:34:54 user nova-compute[75288]:         <nova:port uuid="56cdebbe-eb68-4d33-a733-a4af22ec7369">
Nov 10 22:34:54 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 22:34:54 user nova-compute[75288]:         </nova:port>
Nov 10 22:34:54 user nova-compute[75288]:       </nova:ports>
Nov 10 22:34:54 user nova-compute[75288]:     </nova:instance>
Nov 10 22:34:54 user nova-compute[75288]:   </metadata>
Nov 10 22:34:54 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:34:54 user nova-compute[75288]:     <system>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="serial">80788251-eb95-4022-8170-d219f083c64f</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="uuid">80788251-eb95-4022-8170-d219f083c64f</entry>
Nov 10 22:34:54 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:34:54 user nova-compute[75288]:     </system>
Nov 10 22:34:54 user nova-compute[75288]:   </sysinfo>
Nov 10 22:34:54 user nova-compute[75288]:   <os>
Nov 10 22:34:54 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:34:54 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:34:54 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:34:54 user nova-compute[75288]:   </os>
Nov 10 22:34:54 user nova-compute[75288]:   <features>
Nov 10 22:34:54 user nova-compute[75288]:     <acpi/>
Nov 10 22:34:54 user nova-compute[75288]:     <apic/>
Nov 10 22:34:54 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:34:54 user nova-compute[75288]:   </features>
Nov 10 22:34:54 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:34:54 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:34:54 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:34:54 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:34:54 user nova-compute[75288]:   </clock>
Nov 10 22:34:54 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:34:54 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:34:54 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:34:54 user nova-compute[75288]:   </cpu>
Nov 10 22:34:54 user nova-compute[75288]:   <devices>
Nov 10 22:34:54 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:34:54 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:34:54 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk"/>
Nov 10 22:34:54 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:34:54 user nova-compute[75288]:     </disk>
Nov 10 22:34:54 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:34:54 user nova-compute[75288]:       <mac address="fa:16:3e:35:65:5d"/>
Nov 10 22:34:54 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:54 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:34:54 user nova-compute[75288]:       <target dev="tap56cdebbe-eb"/>
Nov 10 22:34:54 user nova-compute[75288]:     </interface>
Nov 10 22:34:54 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:34:54 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/console.log" append="off"/>
Nov 10 22:34:54 user nova-compute[75288]:     </serial>
Nov 10 22:34:54 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:34:54 user nova-compute[75288]:     <video>
Nov 10 22:34:54 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:34:54 user nova-compute[75288]:     </video>
Nov 10 22:34:54 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:34:54 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:34:54 user nova-compute[75288]:     </rng>
Nov 10 22:34:54 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:34:54 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:34:54 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:34:54 user nova-compute[75288]:     </memballoon>
Nov 10 22:34:54 user nova-compute[75288]:   </devices>
Nov 10 22:34:54 user nova-compute[75288]: </domain>
Nov 10 22:34:54 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1709310066',display_name='tempest-VolumesAdminNegativeTest-server-1709310066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1709310066',id=7,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARaNJ2Q85Dq6STMwQ2qAyc+61Bi+oImbfRX6UEkYjPouffmPHIZOVfyyaRKvIJU2GToL16dOH0wObruYZfH0ILro1rtijf5ZIafH9UcXTXq9JJeugyyRx4da1jpL8zXXA==',key_name='tempest-keypair-1168477474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ddead166794fd4b660457f109f7bc3',ramdisk_id='',reservation_id='r-4k0sollv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1375484400',owner_user_name='tempest-VolumesAdminNegativeTest-1375484400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe464c9138840019ac3a32c3c9bcfab',uuid=80788251-eb95-4022-8170-d219f083c64f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converting VIF {"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:65:5d,bridge_name='br-int',has_traffic_filtering=True,id=56cdebbe-eb68-4d33-a733-a4af22ec7369,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cdebbe-eb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG os_vif [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:65:5d,bridge_name='br-int',has_traffic_filtering=True,id=56cdebbe-eb68-4d33-a733-a4af22ec7369,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cdebbe-eb') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ab35173-d6ac-5827-8396-6feb5b6667aa', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56cdebbe-eb, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56cdebbe-eb, col_values=(('qos', UUID('3609198b-36d0-4057-aa80-e77091e35823')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56cdebbe-eb, col_values=(('external_ids', {'iface-id': '56cdebbe-eb68-4d33-a733-a4af22ec7369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:65:5d', 'vm-uuid': '80788251-eb95-4022-8170-d219f083c64f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:54 user nova-compute[75288]: INFO os_vif [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:65:5d,bridge_name='br-int',has_traffic_filtering=True,id=56cdebbe-eb68-4d33-a733-a4af22ec7369,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cdebbe-eb')
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] No VIF found with MAC fa:16:3e:35:65:5d, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updated VIF entry in instance network info cache for port 1b3b08c2-56ad-41fe-b4f9-80f63d87641f. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updating instance_info_cache with network_info: [{"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ef618ad6-8bc7-4568-9ef2-3089ded0a6ac req-116ce06d-e02b-4436-9831-9d357782f7ee service nova] Releasing lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-e54f7dc7-790f-4e82-b8dc-30b7efa3589f req-07af0351-86e8-4d47-bd56-63f0ee5236df service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received event network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:34:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e54f7dc7-790f-4e82-b8dc-30b7efa3589f req-07af0351-86e8-4d47-bd56-63f0ee5236df service nova] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:34:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e54f7dc7-790f-4e82-b8dc-30b7efa3589f req-07af0351-86e8-4d47-bd56-63f0ee5236df service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:34:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e54f7dc7-790f-4e82-b8dc-30b7efa3589f req-07af0351-86e8-4d47-bd56-63f0ee5236df service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:34:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-e54f7dc7-790f-4e82-b8dc-30b7efa3589f req-07af0351-86e8-4d47-bd56-63f0ee5236df service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] No waiting events found dispatching network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:34:55 user nova-compute[75288]: WARNING nova.compute.manager [req-e54f7dc7-790f-4e82-b8dc-30b7efa3589f req-07af0351-86e8-4d47-bd56-63f0ee5236df service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received unexpected event network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 for instance with vm_state active and task_state None.
Nov 10 22:34:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Creating config drive at /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk.config
Nov 10 22:34:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzclf22vl {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:34:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzclf22vl" returned: 0 in 0.143s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:34:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updated VIF entry in instance network info cache for port 56cdebbe-eb68-4d33-a733-a4af22ec7369. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:34:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updating instance_info_cache with network_info: [{"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:34:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fd12860a-b068-4d90-8182-27bd11387ab2 req-14fa4839-f483-4bdf-b8eb-caf65b33a7dc service nova] Releasing lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:34:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-27e929cb-e6c6-4792-9d12-3d7450432509 req-df1b9594-3eb1-4cf6-a502-546daa8435dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27e929cb-e6c6-4792-9d12-3d7450432509 req-df1b9594-3eb1-4cf6-a502-546daa8435dd service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27e929cb-e6c6-4792-9d12-3d7450432509 req-df1b9594-3eb1-4cf6-a502-546daa8435dd service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27e929cb-e6c6-4792-9d12-3d7450432509 req-df1b9594-3eb1-4cf6-a502-546daa8435dd service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-27e929cb-e6c6-4792-9d12-3d7450432509 req-df1b9594-3eb1-4cf6-a502-546daa8435dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:00 user nova-compute[75288]: WARNING nova.compute.manager [req-27e929cb-e6c6-4792-9d12-3d7450432509 req-df1b9594-3eb1-4cf6-a502-546daa8435dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received unexpected event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with vm_state active and task_state None.
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:35:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 80788251-eb95-4022-8170-d219f083c64f] Instance spawned successfully.
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:35:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Instance spawned successfully.
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-55b6cb25-367b-431f-8c4b-29bb42ec4707 req-dc9b32b4-d94f-4617-94f6-e9e6c902c4a8 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-55b6cb25-367b-431f-8c4b-29bb42ec4707 req-dc9b32b4-d94f-4617-94f6-e9e6c902c4a8 service nova] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-55b6cb25-367b-431f-8c4b-29bb42ec4707 req-dc9b32b4-d94f-4617-94f6-e9e6c902c4a8 service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-55b6cb25-367b-431f-8c4b-29bb42ec4707 req-dc9b32b4-d94f-4617-94f6-e9e6c902c4a8 service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-55b6cb25-367b-431f-8c4b-29bb42ec4707 req-dc9b32b4-d94f-4617-94f6-e9e6c902c4a8 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] No waiting events found dispatching network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:02 user nova-compute[75288]: WARNING nova.compute.manager [req-55b6cb25-367b-431f-8c4b-29bb42ec4707 req-dc9b32b4-d94f-4617-94f6-e9e6c902c4a8 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received unexpected event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 for instance with vm_state active and task_state None.
Nov 10 22:35:02 user nova-compute[75288]: INFO nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Took 11.39 seconds to spawn the instance on the hypervisor.
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:35:02 user nova-compute[75288]: INFO nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Took 14.82 seconds to spawn the instance on the hypervisor.
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:35:02 user nova-compute[75288]: INFO nova.compute.manager [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Took 13.42 seconds to build instance.
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4865c6a-b7ae-4d2c-b163-b25d8f3241d6 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.942s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:02 user nova-compute[75288]: INFO nova.compute.manager [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Took 16.23 seconds to build instance.
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fa52e8c-54a5-4337-bb1d-d8214cf943bf tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.434s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-826ba11a-c53f-4928-9465-8419b04e8e91 req-636f5c27-ad24-44ac-904b-4e85aba24be2 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-826ba11a-c53f-4928-9465-8419b04e8e91 req-636f5c27-ad24-44ac-904b-4e85aba24be2 service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-826ba11a-c53f-4928-9465-8419b04e8e91 req-636f5c27-ad24-44ac-904b-4e85aba24be2 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-826ba11a-c53f-4928-9465-8419b04e8e91 req-636f5c27-ad24-44ac-904b-4e85aba24be2 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-826ba11a-c53f-4928-9465-8419b04e8e91 req-636f5c27-ad24-44ac-904b-4e85aba24be2 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:02 user nova-compute[75288]: WARNING nova.compute.manager [req-826ba11a-c53f-4928-9465-8419b04e8e91 req-636f5c27-ad24-44ac-904b-4e85aba24be2 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received unexpected event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with vm_state active and task_state None.
Nov 10 22:35:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] No waiting events found dispatching network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:04 user nova-compute[75288]: WARNING nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received unexpected event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 for instance with vm_state active and task_state None.
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:04 user nova-compute[75288]: WARNING nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state active and task_state None.
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:04 user nova-compute[75288]: WARNING nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state active and task_state None.
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] No waiting events found dispatching network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:04 user nova-compute[75288]: WARNING nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received unexpected event network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 for instance with vm_state active and task_state None.
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] No waiting events found dispatching network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:04 user nova-compute[75288]: WARNING nova.compute.manager [req-abcd6613-7e77-4960-a681-0e9e19d8a6d0 req-feef07de-ae14-4fd0-81e1-2a7f40324282 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received unexpected event network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 for instance with vm_state active and task_state None.
Nov 10 22:35:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-fd3295b2-5b3f-4888-9854-ca601e53dc8b req-ee9d0599-6493-428e-a181-85295341e7b1 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fd3295b2-5b3f-4888-9854-ca601e53dc8b req-ee9d0599-6493-428e-a181-85295341e7b1 service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fd3295b2-5b3f-4888-9854-ca601e53dc8b req-ee9d0599-6493-428e-a181-85295341e7b1 service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fd3295b2-5b3f-4888-9854-ca601e53dc8b req-ee9d0599-6493-428e-a181-85295341e7b1 service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-fd3295b2-5b3f-4888-9854-ca601e53dc8b req-ee9d0599-6493-428e-a181-85295341e7b1 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:04 user nova-compute[75288]: WARNING nova.compute.manager [req-fd3295b2-5b3f-4888-9854-ca601e53dc8b req-ee9d0599-6493-428e-a181-85295341e7b1 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received unexpected event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with vm_state active and task_state None.
Nov 10 22:35:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-8663e180-783b-4d76-b4c4-d61f1b441b78 req-4204c5d4-3065-4886-b0aa-1ee823edb347 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8663e180-783b-4d76-b4c4-d61f1b441b78 req-4204c5d4-3065-4886-b0aa-1ee823edb347 service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8663e180-783b-4d76-b4c4-d61f1b441b78 req-4204c5d4-3065-4886-b0aa-1ee823edb347 service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8663e180-783b-4d76-b4c4-d61f1b441b78 req-4204c5d4-3065-4886-b0aa-1ee823edb347 service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-8663e180-783b-4d76-b4c4-d61f1b441b78 req-4204c5d4-3065-4886-b0aa-1ee823edb347 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:06 user nova-compute[75288]: WARNING nova.compute.manager [req-8663e180-783b-4d76-b4c4-d61f1b441b78 req-4204c5d4-3065-4886-b0aa-1ee823edb347 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received unexpected event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with vm_state active and task_state None.
Nov 10 22:35:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:35:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:07 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:35:07 user nova-compute[75288]: INFO nova.compute.claims [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Claim successful on node user
Nov 10 22:35:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:35:08 user nova-compute[75288]: INFO nova.compute.claims [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Claim successful on node user
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.policy [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b68e6d2a49c74a6f8deb59ad6074a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928ef09385a4ebd9e95b8b440865065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:35:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Creating image(s)
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk 1073741824" returned: 0 in 0.070s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Successfully created port: 9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.policy [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9852766749f2436b82672bf33c38589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046e40def5c44f60bace530257d51eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:35:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Creating image(s)
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "/opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "/opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Cannot resize image /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Ensure instance console log exists: /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.241s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk 1073741824" returned: 0 in 0.062s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.222s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Successfully updated port: 9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Successfully created port: f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Cannot resize image /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Ensure instance console log exists: /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquired lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-changed-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Refreshing instance network info cache due to event network-changed-9a1df759-b656-4c5e-af6f-746ce89aefca. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] Acquiring lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:35:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Releasing lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Instance network_info: |[{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] Acquired lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Refreshing network info cache for port 9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Start _get_guest_xml network_info=[{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:35:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:35:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converting VIF {"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=9a1df759-b656-4c5e-af6f-746ce89aefca,network=Network(126d6040-2de3-4813-b64c-a939ab148beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1df759-b6') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'pci_devices' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:35:11 user nova-compute[75288]:   <uuid>d5b1e547-fd1e-432b-a921-59f3c4702c47</uuid>
Nov 10 22:35:11 user nova-compute[75288]:   <name>instance-00000008</name>
Nov 10 22:35:11 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:35:11 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:35:11 user nova-compute[75288]:   <metadata>
Nov 10 22:35:11 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:35:11 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:35:11 user nova-compute[75288]:       <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:35:11 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:35:11</nova:creationTime>
Nov 10 22:35:11 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:35:11 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:35:11 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:35:11 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:35:11 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:35:11 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:35:11 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:35:11 user nova-compute[75288]:       <nova:owner>
Nov 10 22:35:11 user nova-compute[75288]:         <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:35:11 user nova-compute[75288]:         <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:35:11 user nova-compute[75288]:       </nova:owner>
Nov 10 22:35:11 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:35:11 user nova-compute[75288]:       <nova:ports>
Nov 10 22:35:11 user nova-compute[75288]:         <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:35:11 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:35:11 user nova-compute[75288]:         </nova:port>
Nov 10 22:35:11 user nova-compute[75288]:       </nova:ports>
Nov 10 22:35:11 user nova-compute[75288]:     </nova:instance>
Nov 10 22:35:11 user nova-compute[75288]:   </metadata>
Nov 10 22:35:11 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:35:11 user nova-compute[75288]:     <system>
Nov 10 22:35:11 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:35:11 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:35:11 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:35:11 user nova-compute[75288]:       <entry name="serial">d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:35:11 user nova-compute[75288]:       <entry name="uuid">d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:35:11 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:35:11 user nova-compute[75288]:     </system>
Nov 10 22:35:11 user nova-compute[75288]:   </sysinfo>
Nov 10 22:35:11 user nova-compute[75288]:   <os>
Nov 10 22:35:11 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:35:11 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:35:11 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:35:11 user nova-compute[75288]:   </os>
Nov 10 22:35:11 user nova-compute[75288]:   <features>
Nov 10 22:35:11 user nova-compute[75288]:     <acpi/>
Nov 10 22:35:11 user nova-compute[75288]:     <apic/>
Nov 10 22:35:11 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:35:11 user nova-compute[75288]:   </features>
Nov 10 22:35:11 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:35:11 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:35:11 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:35:11 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:35:11 user nova-compute[75288]:   </clock>
Nov 10 22:35:11 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:35:11 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:35:11 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:35:11 user nova-compute[75288]:   </cpu>
Nov 10 22:35:11 user nova-compute[75288]:   <devices>
Nov 10 22:35:11 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:35:11 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:35:11 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk"/>
Nov 10 22:35:11 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:35:11 user nova-compute[75288]:     </disk>
Nov 10 22:35:11 user nova-compute[75288]:     <disk type="file" device="cdrom">
Nov 10 22:35:11 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 22:35:11 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config"/>
Nov 10 22:35:11 user nova-compute[75288]:       <target dev="hda" bus="ide"/>
Nov 10 22:35:11 user nova-compute[75288]:     </disk>
Nov 10 22:35:11 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:35:11 user nova-compute[75288]:       <mac address="fa:16:3e:2c:d0:b2"/>
Nov 10 22:35:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:35:11 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:35:11 user nova-compute[75288]:       <target dev="tap9a1df759-b6"/>
Nov 10 22:35:11 user nova-compute[75288]:     </interface>
Nov 10 22:35:11 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:35:11 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log" append="off"/>
Nov 10 22:35:11 user nova-compute[75288]:     </serial>
Nov 10 22:35:11 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:35:11 user nova-compute[75288]:     <video>
Nov 10 22:35:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:35:11 user nova-compute[75288]:     </video>
Nov 10 22:35:11 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:35:11 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:35:11 user nova-compute[75288]:     </rng>
Nov 10 22:35:11 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:35:11 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:35:11 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:35:11 user nova-compute[75288]:     </memballoon>
Nov 10 22:35:11 user nova-compute[75288]:   </devices>
Nov 10 22:35:11 user nova-compute[75288]: </domain>
Nov 10 22:35:11 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converting VIF {"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=9a1df759-b656-4c5e-af6f-746ce89aefca,network=Network(126d6040-2de3-4813-b64c-a939ab148beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1df759-b6') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG os_vif [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=9a1df759-b656-4c5e-af6f-746ce89aefca,network=Network(126d6040-2de3-4813-b64c-a939ab148beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1df759-b6') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c881c22f-f072-5aec-8c71-fabb83b6a4e3', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a1df759-b6, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a1df759-b6, col_values=(('qos', UUID('805d764b-1a20-461e-bca3-f0f918b87671')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a1df759-b6, col_values=(('external_ids', {'iface-id': '9a1df759-b656-4c5e-af6f-746ce89aefca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:d0:b2', 'vm-uuid': 'd5b1e547-fd1e-432b-a921-59f3c4702c47'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:11 user nova-compute[75288]: INFO os_vif [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=9a1df759-b656-4c5e-af6f-746ce89aefca,network=Network(126d6040-2de3-4813-b64c-a939ab148beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1df759-b6')
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No VIF found with MAC fa:16:3e:2c:d0:b2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:35:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Using config drive
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Successfully updated port: f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquired lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-changed-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Refreshing instance network info cache due to event network-changed-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] Acquiring lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:35:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Creating config drive at /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7zn0tcy2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7zn0tcy2" returned: 0 in 0.072s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updated VIF entry in instance network info cache for port 9a1df759-b656-4c5e-af6f-746ce89aefca. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:35:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e179d94c-af68-42a8-a67c-bec3f3c41876 req-a0bb56e3-d529-46ed-8d95-63be51a506ce service nova] Releasing lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Updating instance_info_cache with network_info: [{"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Releasing lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Instance network_info: |[{"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] Acquired lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Refreshing network info cache for port f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Start _get_guest_xml network_info=[{"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:35:12 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:35:12 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-948841717',display_name='tempest-VolumesAssistedSnapshotsTest-server-948841717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-948841717',id=9,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUxqYFXebKbzz3MZfOKRjqfYE6IngpmYUGeyQcrBtFXyqfnfY1bvKWSWiJ5uizdpkULKkZRoy2IeW6b6Fd4o4gpn3AlNUZ5Pzn+pMbGuMQPSkBXtL9dexdULCGUxNUJHQ==',key_name='tempest-keypair-1998331293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046e40def5c44f60bace530257d51eb2',ramdisk_id='',reservation_id='r-agueb6nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1489622189',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1489622189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9852766749f2436b82672bf33c38589f',uuid=5e3770a5-16c7-4b7e-8826-ebd2861085b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Converting VIF {"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:05:f5,bridge_name='br-int',has_traffic_filtering=True,id=f64e4268-cd86-4d6f-a9d5-3aede48c6c5c,network=Network(80c98901-f52b-4c61-9065-127a9889eb15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64e4268-cd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e3770a5-16c7-4b7e-8826-ebd2861085b4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:35:12 user nova-compute[75288]:   <uuid>5e3770a5-16c7-4b7e-8826-ebd2861085b4</uuid>
Nov 10 22:35:12 user nova-compute[75288]:   <name>instance-00000009</name>
Nov 10 22:35:12 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:35:12 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:35:12 user nova-compute[75288]:   <metadata>
Nov 10 22:35:12 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:35:12 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:35:12 user nova-compute[75288]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-948841717</nova:name>
Nov 10 22:35:12 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:35:12</nova:creationTime>
Nov 10 22:35:12 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:35:12 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:35:12 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:35:12 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:35:12 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:35:12 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:35:12 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:35:12 user nova-compute[75288]:       <nova:owner>
Nov 10 22:35:12 user nova-compute[75288]:         <nova:user uuid="9852766749f2436b82672bf33c38589f">tempest-VolumesAssistedSnapshotsTest-1489622189-project-member</nova:user>
Nov 10 22:35:12 user nova-compute[75288]:         <nova:project uuid="046e40def5c44f60bace530257d51eb2">tempest-VolumesAssistedSnapshotsTest-1489622189</nova:project>
Nov 10 22:35:12 user nova-compute[75288]:       </nova:owner>
Nov 10 22:35:12 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:35:12 user nova-compute[75288]:       <nova:ports>
Nov 10 22:35:12 user nova-compute[75288]:         <nova:port uuid="f64e4268-cd86-4d6f-a9d5-3aede48c6c5c">
Nov 10 22:35:12 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 22:35:12 user nova-compute[75288]:         </nova:port>
Nov 10 22:35:12 user nova-compute[75288]:       </nova:ports>
Nov 10 22:35:12 user nova-compute[75288]:     </nova:instance>
Nov 10 22:35:12 user nova-compute[75288]:   </metadata>
Nov 10 22:35:12 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:35:12 user nova-compute[75288]:     <system>
Nov 10 22:35:12 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:35:12 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:35:12 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:35:12 user nova-compute[75288]:       <entry name="serial">5e3770a5-16c7-4b7e-8826-ebd2861085b4</entry>
Nov 10 22:35:12 user nova-compute[75288]:       <entry name="uuid">5e3770a5-16c7-4b7e-8826-ebd2861085b4</entry>
Nov 10 22:35:12 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:35:12 user nova-compute[75288]:     </system>
Nov 10 22:35:12 user nova-compute[75288]:   </sysinfo>
Nov 10 22:35:12 user nova-compute[75288]:   <os>
Nov 10 22:35:12 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:35:12 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:35:12 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:35:12 user nova-compute[75288]:   </os>
Nov 10 22:35:12 user nova-compute[75288]:   <features>
Nov 10 22:35:12 user nova-compute[75288]:     <acpi/>
Nov 10 22:35:12 user nova-compute[75288]:     <apic/>
Nov 10 22:35:12 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:35:12 user nova-compute[75288]:   </features>
Nov 10 22:35:12 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:35:12 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:35:12 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:35:12 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:35:12 user nova-compute[75288]:   </clock>
Nov 10 22:35:12 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:35:12 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:35:12 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:35:12 user nova-compute[75288]:   </cpu>
Nov 10 22:35:12 user nova-compute[75288]:   <devices>
Nov 10 22:35:12 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:35:12 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:35:12 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk"/>
Nov 10 22:35:12 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:35:12 user nova-compute[75288]:     </disk>
Nov 10 22:35:12 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:35:12 user nova-compute[75288]:       <mac address="fa:16:3e:f8:05:f5"/>
Nov 10 22:35:12 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:35:12 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:35:12 user nova-compute[75288]:       <target dev="tapf64e4268-cd"/>
Nov 10 22:35:12 user nova-compute[75288]:     </interface>
Nov 10 22:35:12 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:35:12 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/console.log" append="off"/>
Nov 10 22:35:12 user nova-compute[75288]:     </serial>
Nov 10 22:35:12 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:35:12 user nova-compute[75288]:     <video>
Nov 10 22:35:12 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:35:12 user nova-compute[75288]:     </video>
Nov 10 22:35:12 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:35:12 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:35:12 user nova-compute[75288]:     </rng>
Nov 10 22:35:12 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:35:12 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:35:12 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:35:12 user nova-compute[75288]:     </memballoon>
Nov 10 22:35:12 user nova-compute[75288]:   </devices>
Nov 10 22:35:12 user nova-compute[75288]: </domain>
Nov 10 22:35:12 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-948841717',display_name='tempest-VolumesAssistedSnapshotsTest-server-948841717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-948841717',id=9,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUxqYFXebKbzz3MZfOKRjqfYE6IngpmYUGeyQcrBtFXyqfnfY1bvKWSWiJ5uizdpkULKkZRoy2IeW6b6Fd4o4gpn3AlNUZ5Pzn+pMbGuMQPSkBXtL9dexdULCGUxNUJHQ==',key_name='tempest-keypair-1998331293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046e40def5c44f60bace530257d51eb2',ramdisk_id='',reservation_id='r-agueb6nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1489622189',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1489622189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9852766749f2436b82672bf33c38589f',uuid=5e3770a5-16c7-4b7e-8826-ebd2861085b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Converting VIF {"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:05:f5,bridge_name='br-int',has_traffic_filtering=True,id=f64e4268-cd86-4d6f-a9d5-3aede48c6c5c,network=Network(80c98901-f52b-4c61-9065-127a9889eb15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64e4268-cd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG os_vif [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:05:f5,bridge_name='br-int',has_traffic_filtering=True,id=f64e4268-cd86-4d6f-a9d5-3aede48c6c5c,network=Network(80c98901-f52b-4c61-9065-127a9889eb15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64e4268-cd') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '192313da-1c34-57af-9ce2-365fe21a545b', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf64e4268-cd, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf64e4268-cd, col_values=(('qos', UUID('0511d93f-1ec3-4486-81bf-f83098a2b4cb')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf64e4268-cd, col_values=(('external_ids', {'iface-id': 'f64e4268-cd86-4d6f-a9d5-3aede48c6c5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:05:f5', 'vm-uuid': '5e3770a5-16c7-4b7e-8826-ebd2861085b4'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:12 user nova-compute[75288]: INFO os_vif [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:05:f5,bridge_name='br-int',has_traffic_filtering=True,id=f64e4268-cd86-4d6f-a9d5-3aede48c6c5c,network=Network(80c98901-f52b-4c61-9065-127a9889eb15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64e4268-cd')
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] No VIF found with MAC fa:16:3e:f8:05:f5, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Updated VIF entry in instance network info cache for port f64e4268-cd86-4d6f-a9d5-3aede48c6c5c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Updating instance_info_cache with network_info: [{"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:35:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b68984ca-8279-4d2b-8501-e0c5df4544e4 req-88a0de15-1664-4a2b-8ce6-38e0696e1b82 service nova] Releasing lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 0 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 22:35:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-a6828ebe-d3c0-4116-8656-8a7bfa158f7e req-9a03a0cb-8858-4d79-b6b0-2e21c78df46a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6828ebe-d3c0-4116-8656-8a7bfa158f7e req-9a03a0cb-8858-4d79-b6b0-2e21c78df46a service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6828ebe-d3c0-4116-8656-8a7bfa158f7e req-9a03a0cb-8858-4d79-b6b0-2e21c78df46a service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6828ebe-d3c0-4116-8656-8a7bfa158f7e req-9a03a0cb-8858-4d79-b6b0-2e21c78df46a service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-a6828ebe-d3c0-4116-8656-8a7bfa158f7e req-9a03a0cb-8858-4d79-b6b0-2e21c78df46a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:14 user nova-compute[75288]: WARNING nova.compute.manager [req-a6828ebe-d3c0-4116-8656-8a7bfa158f7e req-9a03a0cb-8858-4d79-b6b0-2e21c78df46a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received unexpected event network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca for instance with vm_state building and task_state spawning.
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Skipping network cache update for instance because it is Building. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Skipping network cache update for instance because it is Building. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 032de95e-98a7-411d-8726-5bf3a5c0ca49 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:16 user nova-compute[75288]: WARNING nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received unexpected event network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca for instance with vm_state building and task_state spawning.
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] No waiting events found dispatching network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:16 user nova-compute[75288]: WARNING nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received unexpected event network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c for instance with vm_state building and task_state spawning.
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] No waiting events found dispatching network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:16 user nova-compute[75288]: WARNING nova.compute.manager [req-61994ce3-34dc-4923-ba53-152fd66407a3 req-578a4f84-978e-4a7a-b42b-48f5f3d8c43a service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received unexpected event network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c for instance with vm_state building and task_state spawning.
Nov 10 22:35:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-d4b9efe7-b15d-48c3-b066-0d1a816a0edb req-00c950b0-95f4-4d57-b9be-2ba94a760559 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d4b9efe7-b15d-48c3-b066-0d1a816a0edb req-00c950b0-95f4-4d57-b9be-2ba94a760559 service nova] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d4b9efe7-b15d-48c3-b066-0d1a816a0edb req-00c950b0-95f4-4d57-b9be-2ba94a760559 service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d4b9efe7-b15d-48c3-b066-0d1a816a0edb req-00c950b0-95f4-4d57-b9be-2ba94a760559 service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-d4b9efe7-b15d-48c3-b066-0d1a816a0edb req-00c950b0-95f4-4d57-b9be-2ba94a760559 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] No waiting events found dispatching network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:17 user nova-compute[75288]: WARNING nova.compute.manager [req-d4b9efe7-b15d-48c3-b066-0d1a816a0edb req-00c950b0-95f4-4d57-b9be-2ba94a760559 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received unexpected event network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f for instance with vm_state active and task_state None.
Nov 10 22:35:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:35:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:35:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Instance spawned successfully.
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updating instance_info_cache with network_info: [{"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:35:18 user nova-compute[75288]: INFO nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Took 8.53 seconds to spawn the instance on the hypervisor.
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:35:18 user nova-compute[75288]: INFO nova.compute.manager [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Took 9.78 seconds to build instance.
Nov 10 22:35:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Instance spawned successfully.
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fea4754d-1a8d-4286-9774-0ff40c3c630c tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.926s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:18 user nova-compute[75288]: INFO nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Took 9.68 seconds to spawn the instance on the hypervisor.
Nov 10 22:35:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:35:18 user nova-compute[75288]: INFO nova.compute.manager [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Took 10.88 seconds to build instance.
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab8da802-3059-47a4-bc5d-eaa7bf6c0e45 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.082s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-d0f5fa00-8198-49a9-8c26-e5593d64baba req-fbf9331d-791b-4929-89d4-e852908c0146 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d0f5fa00-8198-49a9-8c26-e5593d64baba req-fbf9331d-791b-4929-89d4-e852908c0146 service nova] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d0f5fa00-8198-49a9-8c26-e5593d64baba req-fbf9331d-791b-4929-89d4-e852908c0146 service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d0f5fa00-8198-49a9-8c26-e5593d64baba req-fbf9331d-791b-4929-89d4-e852908c0146 service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-d0f5fa00-8198-49a9-8c26-e5593d64baba req-fbf9331d-791b-4929-89d4-e852908c0146 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] No waiting events found dispatching network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:35:19 user nova-compute[75288]: WARNING nova.compute.manager [req-d0f5fa00-8198-49a9-8c26-e5593d64baba req-fbf9331d-791b-4929-89d4-e852908c0146 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received unexpected event network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f for instance with vm_state active and task_state None.
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:35:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:35:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:35:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=25.674835205078125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:35:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 36cfd3ac-5f27-45f6-9e6b-4581b22b533e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 80788251-eb95-4022-8170-d219f083c64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d5b1e547-fd1e-432b-a921-59f3c4702c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:35:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:35:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:35:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.087s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:35:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:35:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:35:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:36:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:36:16 user nova-compute[75288]: INFO nova.compute.manager [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] instance snapshotting
Nov 10 22:36:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Beginning live snapshot process
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpafi6f05k/c5340a95a1a44a888536b4478d655386.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpafi6f05k/c5340a95a1a44a888536b4478d655386.delta 1073741824" returned: 0 in 0.046s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 22:36:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75288) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 10 22:36:17 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] UEFI support detected
Nov 10 22:36:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Updating instance_info_cache with network_info: [{"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-36cfd3ac-5f27-45f6-9e6b-4581b22b533e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:36:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpafi6f05k/c5340a95a1a44a888536b4478d655386.delta /opt/stack/data/nova/instances/snapshots/tmpafi6f05k/c5340a95a1a44a888536b4478d655386 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpafi6f05k/c5340a95a1a44a888536b4478d655386.delta /opt/stack/data/nova/instances/snapshots/tmpafi6f05k/c5340a95a1a44a888536b4478d655386" returned: 0 in 0.668s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Snapshot extracted, beginning image upload
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:36:19 user nova-compute[75288]: INFO nova.compute.claims [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Claim successful on node user
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:36:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:36:20 user nova-compute[75288]: INFO nova.virt.block_device [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Booting with volume 00a82c99-40d3-48ed-a341-dda7d1603f07 at /dev/vda
Nov 10 22:36:20 user nova-compute[75288]: DEBUG nova.policy [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09aff48c3ed14ceda87ced776db66878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d9c346e8b64225b46aff84560ee0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:36:20 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwuj4vwxs/privsep.sock']
Nov 10 22:36:20 user sudo[86688]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwuj4vwxs/privsep.sock
Nov 10 22:36:20 user sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully created port: dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully created port: 3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:21 user sudo[86688]: pam_unix(sudo:session): session closed for user root
Nov 10 22:36:21 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Spawned new privsep daemon via rootwrap
Nov 10 22:36:21 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 22:36:21 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 22:36:21 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 10 22:36:21 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86709
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b8b21d-6588-4c67-8ce4-0fd527d1214c]: (2,) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[767a9629-c86f-4df2-ac67-0b220311c10b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully created port: 5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing instance network info cache due to event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] Acquiring lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] Acquired lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:22 user nova-compute[75288]: WARNING os_brick.initiator.connectors.nvmeof [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:36:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7231MB free_disk=25.566463470458984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10030db-f150-4d1b-86da-67eaa78aa333]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac2e34-224b-448e-995b-b79bd570d62d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56d93fb-88fc-4007-a064-ca528052831b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Snapshot image upload complete
Nov 10 22:36:22 user nova-compute[75288]: INFO nova.compute.manager [None req-53caaef4-2d2c-4e56-b450-3f47a1e3d2d2 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Took 6.25 seconds to snapshot the instance on the hypervisor.
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:22 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f35950-dad4-4912-b5af-ca983772b8cf]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG os_brick.utils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== get_connector_properties: return (2308ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating existing volume attachment record: 704488a3-8ce0-46c6-8c54-475b5228f01c {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 36cfd3ac-5f27-45f6-9e6b-4581b22b533e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 80788251-eb95-4022-8170-d219f083c64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d5b1e547-fd1e-432b-a921-59f3c4702c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7e41f40b-859f-4239-b5e5-a787af7e28ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updated VIF entry in instance network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d6419f5a-9ebd-4c80-b7b8-50ef8edd48f4 req-509ac1e9-d13d-4120-b731-f155afec66dd service nova] Releasing lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully created port: 7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:36:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:36:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully created port: 371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully updated port: dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-dc7936a1-6060-4ea8-bc0a-d03a995b2902. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully updated port: bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5f74e56d-9997-4d5f-9a2b-6f520a17542c req-3641c20c-1154-41bf-b48e-6f7071bc9cba service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-changed-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Refreshing instance network info cache due to event network-changed-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Refreshing network info cache for port b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updated VIF entry in instance network info cache for port b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-052ff74d-299f-470c-8407-634570743fdf req-6c6a654f-6bf5-4389-ba95-cd2552f16e27 service nova] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lazy-loading 'flavor' on Instance uuid 36cfd3ac-5f27-45f6-9e6b-4581b22b533e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:26 user nova-compute[75288]: INFO nova.compute.manager [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Attaching volume 4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 to /dev/vdb
Nov 10 22:36:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-bcebe502-3e3e-486a-a332-f3679a175811. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7633a2b-4909-4628-8f52-d3a211d0ffc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[33df5110-9636-41a8-a924-ebb11f38f44e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a20e0fe-e212-4dcd-b637-694bb85b25c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc8d3a-5ca8-4040-a058-4307ac34e055]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:27 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:36:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[35491a12-61f5-4ad4-9d82-ec97dda3e45e]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG os_brick.utils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Updating existing volume attachment record: d9e5ce9b-9ddf-4410-ac88-b19854e5b04c {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e032d022-63d9-4641-83ec-8934136c3a8c req-fd8d4387-74ea-4d06-bec2-b5aeac2bf0f2 service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully updated port: f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:36:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully updated port: 3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:36:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-f198f762-e7ad-4362-85ad-735538cf8b1c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:28 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully updated port: 5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-changed-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Refreshing instance network info cache due to event network-changed-a17af079-be58-40cc-a993-4d5304f20445. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Acquiring lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Acquired lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Refreshing network info cache for port a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updated VIF entry in instance network info cache for port a17af079-be58-40cc-a993-4d5304f20445. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Releasing lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port 3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully updated port: 7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:36:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG nova.network.neutron [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e283574e-5d04-4be1-8c8a-da414037c0c5 req-fe11b0bc-473c-43ba-b96d-36cfed76173a service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:30 user nova-compute[75288]: INFO nova.compute.manager [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Shelving
Nov 10 22:36:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Successfully updated port: 371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:36:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-5acd3810-8cbd-425f-af05-8e33cdfa9e5a. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:36:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance destroyed successfully.
Nov 10 22:36:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Beginning cold snapshot process
Nov 10 22:36:31 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:36:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk /opt/stack/data/nova/instances/snapshots/tmpikx31nor/f484490699054e1196a9c02fba477127 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk /opt/stack/data/nova/instances/snapshots/tmpikx31nor/f484490699054e1196a9c02fba477127" returned: 0 in 1.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Snapshot extracted, beginning image upload
Nov 10 22:36:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-unplugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-unplugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:36:33 user nova-compute[75288]: WARNING nova.compute.manager [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received unexpected event network-vif-unplugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 22:36:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:36:33 user nova-compute[75288]: WARNING nova.compute.manager [req-5c9385ff-35ad-4ae6-af73-659263fa0e34 req-40dc3ec7-9b42-4b3a-8bd6-0b9ec06bfc5e service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received unexpected event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 22:36:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [{"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance network_info: |[{"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port 5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updated VIF entry in instance network info cache for port 5acd3810-8cbd-425f-af05-8e33cdfa9e5a. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [{"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-7bf243a0-ae7b-49c7-a602-680b5621df79. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port 7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updated VIF entry in instance network info cache for port 7bf243a0-ae7b-49c7-a602-680b5621df79. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [{"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-371a03ef-3889-464c-a07a-7a9e5e30ddd5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port 371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Snapshot image upload complete
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:36:35 user nova-compute[75288]: INFO nova.compute.manager [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Shelve offloading
Nov 10 22:36:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance destroyed successfully.
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquired lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updated VIF entry in instance network info cache for port 371a03ef-3889-464c-a07a-7a9e5e30ddd5. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [{"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15e1b9bd-25e2-4b2d-8a4e-bc161379c69a req-33832df5-8fc6-42a9-896b-9c8e8ff39ca1 service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:36 user nova-compute[75288]: INFO nova.compute.manager [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Attaching volume 089d5b73-557a-4352-abe4-552db2b71a3f to /dev/vdb
Nov 10 22:36:36 user nova-compute[75288]: DEBUG os_brick.utils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4368771c-7250-420d-b8f9-7da59786b158]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4309285-9fa0-4cae-bb56-3391c20b39eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e00afe-1c97-47ec-9fb1-db6e76f3b52e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095ffc6-557e-4a4a-a099-3f763a4b70aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Releasing lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:36 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[03345ded-55b1-439a-bbec-11b04ba9a4af]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG os_brick.utils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating existing volume attachment record: 0d7c52f6-cbb6-4993-a54e-a1e9319b1868 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-changed-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Refreshing instance network info cache due to event network-changed-1b3b08c2-56ad-41fe-b4f9-80f63d87641f. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] Acquiring lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] Acquired lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Refreshing network info cache for port 1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance destroyed successfully.
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'resources' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-629412587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-629412587',id=3,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsn8RWoTM33U1Wn0XsXWYmBTav3JNsALpJyij1IuoeHWuaRZv8F9nZwHxJycfYTGcA1LdY/Ync7tOpUMY/NKULD8AnmpUADEYZqDSbY5SSjQyoO/dCs/0YMw11L2zKauQ==',key_name='tempest-keypair-864991346',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-qnxqgmhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member',shelved_at='2023-11-10T22:36:35.788504',shelved_host='user',shelved_image_id='095a4252-5e23-47db-a4c0-8fb007c52255'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:36:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=a1701e0c-f9c9-4ba8-81ec-1b9966e033a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG os_vif [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing instance network info cache due to event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] Acquiring lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] Acquired lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0404036a-dd, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f308b34-2560-4116-960e-9b4183704e3b) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:37 user nova-compute[75288]: INFO os_vif [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd')
Nov 10 22:36:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Deleting instance files /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3_del
Nov 10 22:36:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Deletion of /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3_del complete
Nov 10 22:36:37 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Deleted allocations for instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3
Nov 10 22:36:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'numa_topology' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.objects.base [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<a1701e0c-f9c9-4ba8-81ec-1b9966e033a3> lazy-loaded attributes: resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updated VIF entry in instance network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0404036a-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a53f78f-7caa-42ef-8c5c-32ca5e1e9549 req-13259f46-f098-4796-a0af-572d3666fa41 service nova] Releasing lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updated VIF entry in instance network info cache for port 1b3b08c2-56ad-41fe-b4f9-80f63d87641f. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updating instance_info_cache with network_info: [{"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ed45783a-3099-46ab-8595-c45f348812b6 req-7c505104-971f-43ee-90d8-575c7e2ad91b service nova] Releasing lock "refresh_cache-7668df42-4bbb-4913-97e7-3b4b67f94eb1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5be53755-105d-4a18-b81b-0fdc837a1695 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.635s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-changed-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Refreshing instance network info cache due to event network-changed-56cdebbe-eb68-4d33-a733-a4af22ec7369. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] Acquiring lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] Acquired lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Refreshing network info cache for port 56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updated VIF entry in instance network info cache for port 56cdebbe-eb68-4d33-a733-a4af22ec7369. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updating instance_info_cache with network_info: [{"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af1a57ac-32b8-43f1-a57a-faf86110ec42 req-925e75d6-819d-43df-a576-f029a41fbbb7 service nova] Releasing lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:36:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:49 user nova-compute[75288]: INFO nova.virt.block_device [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Booting with volume f8af8288-08e0-4e1c-aa78-9621d9222e7d at /dev/vdb
Nov 10 22:36:49 user nova-compute[75288]: DEBUG os_brick.utils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f98dad-7b45-436a-a3d7-5e13d11ec798]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd84c5-3398-4a76-8892-ecbbef4ac434]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7144c8e5-d5e7-4b8e-aaf7-0a3827a484a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c01589-9e3f-4b97-96d5-9c63907463cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:50 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:36:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed396d-999f-4893-8282-1ef65b831b80]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG os_brick.utils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:36:50 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating existing volume attachment record: 66fc0190-5b4a-4eeb-8134-f5f58ce690b4 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:36:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connector [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Factory for ISCSI on None {{(pid=75288) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UENxmnPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:36:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:36:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:36:56 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcbf165-a545-45ea-a3ef-09c692482777]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:36:56 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8528cea-141b-4064-abb3-6e8fa4ee5819]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38] added
Nov 10 22:36:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3106a779-966f-4b17-aedb-6a0caebe36a9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[975cb876-0b46-41ba-9ba7-c09bb9bf8c6b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UENxmnPZ {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UENxmnPZ" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16369ff-0a6e-48ab-b865-dbb5ef14ab3b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UENxmnPZ'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[742d436d-e831-4544-b34c-9f30de5c5f6c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ef756-4c30-4df0-94df-d5279927ca90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 22:36:56 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 22:36:56 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:36:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 22:36:56 user nova-compute[75288]: 
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[07610a85-dbdd-42d3-9a90-a15a1c53830b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260]
Nov 10 22:36:56 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260] successful.
Nov 10 22:36:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[222be572-dc42-442e-8712-cf7e2cdebcae]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2bb710-9298-4fe4-a2e1-325eb450a862]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:36:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:36:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.224s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a2b15-f9be-40ff-b928-1dfc621d6943]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:36:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UENxmnPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lazy-loading 'flavor' on Instance uuid 7668df42-4bbb-4913-97e7-3b4b67f94eb1 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lazy-loading 'flavor' on Instance uuid 80788251-eb95-4022-8170-d219f083c64f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:57 user nova-compute[75288]: INFO nova.compute.manager [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Attaching volume ac32982d-65d5-4e9b-98c3-9d43b45b6047 to /dev/vdb
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:57 user nova-compute[75288]: INFO nova.compute.manager [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Attaching volume 50714c66-b6cb-4cfd-9302-454984cf5d7a to /dev/sdc
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5803af18-08c6-4f76-8365-41b13b4f563a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e5a74-9629-44de-8503-e45c1f51eadb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b0313f-24ef-432b-b9a1-20c8f991915d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[de31255a-4d11-4e43-bba3-e4744b3ffd6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5d551-dd59-40c1-a1c8-40e60db835a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c14e2af-c023-4e5e-9d0e-c8428ce60785]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:57 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b406833-8b25-4078-9464-a05ab1b03319]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfdd4d0-c8a1-467e-9297-325e48c5e0ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updating existing volume attachment record: 8f5c2442-d6b5-4340-abb1-3659f5db504f {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796db85-8a99-4d8f-b10d-0360a11c3e11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:36:57 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:36:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[80135e7e-0f7a-4f46-a242-dbe4d5c8ee96]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updating existing volume attachment record: 697dde75-8c4f-46c4-9dc7-ac76af5655db {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '23264343361376565', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264343361376565', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lazy-loading 'flavor' on Instance uuid 36cfd3ac-5f27-45f6-9e6b-4581b22b533e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:36:57 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:36:57 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:36:57 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:36:57 user nova-compute[75288]:   <serial>4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38</serial>
Nov 10 22:36:57 user nova-compute[75288]: </disk>
Nov 10 22:36:57 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] No VIF found with MAC fa:16:3e:b6:ec:6e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Acquiring lock "3986f2b4-5e46-4834-9f66-ad5f9a0873bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Lock "3986f2b4-5e46-4834-9f66-ad5f9a0873bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:36:58 user nova-compute[75288]: INFO nova.compute.claims [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Claim successful on node user
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-changed-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Refreshing instance network info cache due to event network-changed-9a1df759-b656-4c5e-af6f-746ce89aefca. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] Acquiring lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] Acquired lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.network.neutron [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Refreshing network info cache for port 9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-changed-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Refreshing instance network info cache due to event network-changed-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] Acquiring lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] Acquired lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.network.neutron [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Refreshing network info cache for port f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:36:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:36:59 user nova-compute[75288]: INFO nova.virt.block_device [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Booting with volume 7f58e6c8-e2d3-4855-94a1-20def0bce957 at /dev/vda
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "interface-d5b1e547-fd1e-432b-a921-59f3c4702c47-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "interface-d5b1e547-fd1e-432b-a921-59f3c4702c47-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'flavor' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.policy [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbb03921b14c4738a322fe082d986aec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb1369d3ab04e03a202a6a630b0fd3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.network.neutron [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updated VIF entry in instance network info cache for port 9a1df759-b656-4c5e-af6f-746ce89aefca. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG nova.network.neutron [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:36:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8c71c50-b4ea-4a8b-9a91-ebcd5cd53cfe req-75d7e7fe-1acb-41b2-9e40-11170eb8e523 service nova] Releasing lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'pci_requests' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.objects.base [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Object Instance<d5b1e547-fd1e-432b-a921-59f3c4702c47> lazy-loaded attributes: flavor,pci_requests {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Updated VIF entry in instance network info cache for port f64e4268-cd86-4d6f-a9d5-3aede48c6c5c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Updating instance_info_cache with network_info: [{"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.policy [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b68e6d2a49c74a6f8deb59ad6074a0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928ef09385a4ebd9e95b8b440865065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-49bbc853-a8cd-4293-b879-3e59afdc6d5d req-66865016-5b78-4b82-b955-d02110941a1c service nova] Releasing lock "refresh_cache-5e3770a5-16c7-4b7e-8826-ebd2861085b4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully created port: aed4704e-0fe6-4636-92fc-2e3d4b13b7e9 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:37:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Successfully created port: 52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully created port: 47bcd3bf-0fb2-4335-b6ca-afe1b8a61031 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Successfully updated port: 52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquired lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-changed-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Refreshing instance network info cache due to event network-changed-52e65878-df33-444f-a67c-3957c36b598c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] Acquiring lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully created port: 7d5b9e0c-5479-40ab-a777-5aa92d724f3e {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Releasing lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] Acquired lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Refreshing network info cache for port 52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converting VIF {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_vif [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85ebf42e-390f-5ef7-81e4-5db344c99f6c', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e65878-df, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52e65878-df, col_values=(('qos', UUID('ca868670-ed91-4ded-8338-4378b1ee64b4')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52e65878-df, col_values=(('external_ids', {'iface-id': '52e65878-df33-444f-a67c-3957c36b598c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:37:a5', 'vm-uuid': 'd5b1e547-fd1e-432b-a921-59f3c4702c47'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: INFO os_vif [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df')
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converting VIF {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] attach device xml: <interface type="ethernet">
Nov 10 22:37:02 user nova-compute[75288]:   <mac address="fa:16:3e:5f:37:a5"/>
Nov 10 22:37:02 user nova-compute[75288]:   <model type="virtio"/>
Nov 10 22:37:02 user nova-compute[75288]:   <mtu size="1442"/>
Nov 10 22:37:02 user nova-compute[75288]:   <target dev="tap52e65878-df"/>
Nov 10 22:37:02 user nova-compute[75288]: </interface>
Nov 10 22:37:02 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJhnapHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:02 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0809e2ed-91ee-4659-9ffd-41d544e7de5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:37:02 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8bf7f5-4d2b-410e-a821-d4e2aab02cb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f] added
Nov 10 22:37:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[847ca335-b80b-4e64-aac7-52286ff1fb1f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544b207-de04-4117-a708-b4c0d4e65ea8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJhnapHb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJhnapHb" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71c180-2f31-4fad-b94e-ed550fb64678]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJhnapHb'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb401b-463d-44a6-b4f7-f39deb32a452]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0f73b7-e13b-4eac-99b5-3702fc806ec8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdcb134-03f5-46c0-a2da-7b40bdbaf90f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]
Nov 10 22:37:02 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No VIF found with MAC fa:16:3e:2c:d0:b2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81912e08-2656-4ac3-8fe1-2859d7704849]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:37:02 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Nov 10 22:37:02 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:37:02 user nova-compute[75288]:   <nova:creationTime>2023-11-10 22:37:02</nova:creationTime>
Nov 10 22:37:02 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Nov 10 22:37:02 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Nov 10 22:37:02 user nova-compute[75288]:   </nova:flavor>
Nov 10 22:37:02 user nova-compute[75288]:   <nova:owner>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:37:02 user nova-compute[75288]:   </nova:owner>
Nov 10 22:37:02 user nova-compute[75288]:   <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:37:02 user nova-compute[75288]:   <nova:ports>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:37:02 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:37:02 user nova-compute[75288]:     </nova:port>
Nov 10 22:37:02 user nova-compute[75288]:     <nova:port uuid="52e65878-df33-444f-a67c-3957c36b598c">
Nov 10 22:37:02 user nova-compute[75288]:       <nova:ip type="fixed" address="10.10.10.31" ipVersion="4"/>
Nov 10 22:37:02 user nova-compute[75288]:     </nova:port>
Nov 10 22:37:02 user nova-compute[75288]:   </nova:ports>
Nov 10 22:37:02 user nova-compute[75288]: </nova:instance>
Nov 10 22:37:02 user nova-compute[75288]:  {{(pid=75288) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61633a0-f284-48fc-b99d-6e5abf630411]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1a38d9fa-c3d5-4e5a-8a5e-e4795768cab1 req-4e37e392-de53-4dda-bf3b-ae26c169f7bc service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1a38d9fa-c3d5-4e5a-8a5e-e4795768cab1 req-4e37e392-de53-4dda-bf3b-ae26c169f7bc service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1a38d9fa-c3d5-4e5a-8a5e-e4795768cab1 req-4e37e392-de53-4dda-bf3b-ae26c169f7bc service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1a38d9fa-c3d5-4e5a-8a5e-e4795768cab1 req-4e37e392-de53-4dda-bf3b-ae26c169f7bc service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1a38d9fa-c3d5-4e5a-8a5e-e4795768cab1 req-4e37e392-de53-4dda-bf3b-ae26c169f7bc service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:02 user nova-compute[75288]: WARNING nova.compute.manager [req-1a38d9fa-c3d5-4e5a-8a5e-e4795768cab1 req-4e37e392-de53-4dda-bf3b-ae26c169f7bc service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received unexpected event network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c for instance with vm_state active and task_state None.
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0ca581c8-b9d7-4517-9e03-9aaf06adc274 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "interface-d5b1e547-fd1e-432b-a921-59f3c4702c47-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.077s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully created port: 391aa5f6-f153-4ca1-af05-a0a208bf7e09 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d52ad73-4bb8-46a3-a9a5-a9ac983139c5]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJhnapHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG nova.network.neutron [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updated VIF entry in instance network info cache for port 52e65878-df33-444f-a67c-3957c36b598c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG nova.network.neutron [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bafb3e9a-a149-4aff-9b45-1ee7219a28ec req-2f07a99a-ca95-4635-a0da-920b1feca13d service nova] Releasing lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully created port: 50768b8a-1174-4e18-bce6-764ec39a7d6b {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '26637633331373636', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633331373636', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:37:03 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:03 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:37:03 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:37:03 user nova-compute[75288]:   <serial>089d5b73-557a-4352-abe4-552db2b71a3f</serial>
Nov 10 22:37:03 user nova-compute[75288]: </disk>
Nov 10 22:37:03 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully updated port: aed4704e-0fe6-4636-92fc-2e3d4b13b7e9 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Received event network-changed-aed4704e-0fe6-4636-92fc-2e3d4b13b7e9 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing instance network info cache due to event network-changed-aed4704e-0fe6-4636-92fc-2e3d4b13b7e9. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing network info cache for port aed4704e-0fe6-4636-92fc-2e3d4b13b7e9 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No VIF found with MAC fa:16:3e:36:3b:c0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ef75f688-9b18-4b55-a1f8-fa6ec2959b8d req-3bf70ff3-5797-4ff0-9f7e-f5f8c021706f service nova] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-9b983838-344c-41fa-aa4a-6b6572f8212c req-7b385794-2b3e-4543-b142-921b050e5b5a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9b983838-344c-41fa-aa4a-6b6572f8212c req-7b385794-2b3e-4543-b142-921b050e5b5a service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9b983838-344c-41fa-aa4a-6b6572f8212c req-7b385794-2b3e-4543-b142-921b050e5b5a service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9b983838-344c-41fa-aa4a-6b6572f8212c req-7b385794-2b3e-4543-b142-921b050e5b5a service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-9b983838-344c-41fa-aa4a-6b6572f8212c req-7b385794-2b3e-4543-b142-921b050e5b5a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:04 user nova-compute[75288]: WARNING nova.compute.manager [req-9b983838-344c-41fa-aa4a-6b6572f8212c req-7b385794-2b3e-4543-b142-921b050e5b5a service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received unexpected event network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c for instance with vm_state active and task_state None.
Nov 10 22:37:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully updated port: 2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully updated port: 10deb149-79ae-409d-b69d-3d9b74662b72 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Received event network-changed-2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing instance network info cache due to event network-changed-2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing network info cache for port 2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Received event network-changed-10deb149-79ae-409d-b69d-3d9b74662b72 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing instance network info cache due to event network-changed-10deb149-79ae-409d-b69d-3d9b74662b72. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing network info cache for port 10deb149-79ae-409d-b69d-3d9b74662b72 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully updated port: 47bcd3bf-0fb2-4335-b6ca-afe1b8a61031 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d3458d4-b915-4246-adae-e3b4653710e6 req-ca2c41c8-dc84-4577-810a-396133b881b4 service nova] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:07 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully updated port: 7d5b9e0c-5479-40ab-a777-5aa92d724f3e {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully updated port: 391aa5f6-f153-4ca1-af05-a0a208bf7e09 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Received event network-changed-47bcd3bf-0fb2-4335-b6ca-afe1b8a61031 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing instance network info cache due to event network-changed-47bcd3bf-0fb2-4335-b6ca-afe1b8a61031. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing network info cache for port 47bcd3bf-0fb2-4335-b6ca-afe1b8a61031 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Received event network-changed-7d5b9e0c-5479-40ab-a777-5aa92d724f3e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing instance network info cache due to event network-changed-7d5b9e0c-5479-40ab-a777-5aa92d724f3e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing network info cache for port 7d5b9e0c-5479-40ab-a777-5aa92d724f3e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15464e35-f7db-4e47-a1ab-ce3b776fa03f req-8654da33-3bf1-406e-8239-aad158bd728b service nova] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Successfully updated port: 50768b8a-1174-4e18-bce6-764ec39a7d6b {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:37:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:37:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Received event network-changed-391aa5f6-f153-4ca1-af05-a0a208bf7e09 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing instance network info cache due to event network-changed-391aa5f6-f153-4ca1-af05-a0a208bf7e09. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [{"id": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "address": "fa:16:3e:eb:22:53", "network": {"id": "514b6a3c-3c91-4b6b-91f4-eca03aa8643f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1864138639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed4704e-0f", "ovs_interfaceid": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "address": "fa:16:3e:b2:b6:6e", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3a14a7-5e", "ovs_interfaceid": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10deb149-79ae-409d-b69d-3d9b74662b72", "address": "fa:16:3e:b1:4e:52", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10deb149-79", "ovs_interfaceid": "10deb149-79ae-409d-b69d-3d9b74662b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "address": "fa:16:3e:03:18:4c", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47bcd3bf-0f", "ovs_interfaceid": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "address": "fa:16:3e:6d:99:f0", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5b9e0c-54", "ovs_interfaceid": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "address": "fa:16:3e:e7:1e:fd", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391aa5f6-f1", "ovs_interfaceid": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "address": "fa:16:3e:67:0e:4f", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50768b8a-11", "ovs_interfaceid": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance network_info: |[{"id": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "address": "fa:16:3e:eb:22:53", "network": {"id": "514b6a3c-3c91-4b6b-91f4-eca03aa8643f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1864138639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed4704e-0f", "ovs_interfaceid": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "address": "fa:16:3e:b2:b6:6e", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3a14a7-5e", "ovs_interfaceid": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10deb149-79ae-409d-b69d-3d9b74662b72", "address": "fa:16:3e:b1:4e:52", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10deb149-79", "ovs_interfaceid": "10deb149-79ae-409d-b69d-3d9b74662b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "address": "fa:16:3e:03:18:4c", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47bcd3bf-0f", "ovs_interfaceid": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "address": "fa:16:3e:6d:99:f0", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5b9e0c-54", "ovs_interfaceid": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "address": "fa:16:3e:e7:1e:fd", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391aa5f6-f1", "ovs_interfaceid": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "address": "fa:16:3e:67:0e:4f", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50768b8a-11", "ovs_interfaceid": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:37:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing network info cache for port 391aa5f6-f153-4ca1-af05-a0a208bf7e09 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updated VIF entry in instance network info cache for port 391aa5f6-f153-4ca1-af05-a0a208bf7e09. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [{"id": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "address": "fa:16:3e:eb:22:53", "network": {"id": "514b6a3c-3c91-4b6b-91f4-eca03aa8643f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1864138639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed4704e-0f", "ovs_interfaceid": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "address": "fa:16:3e:b2:b6:6e", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3a14a7-5e", "ovs_interfaceid": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10deb149-79ae-409d-b69d-3d9b74662b72", "address": "fa:16:3e:b1:4e:52", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10deb149-79", "ovs_interfaceid": "10deb149-79ae-409d-b69d-3d9b74662b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "address": "fa:16:3e:03:18:4c", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47bcd3bf-0f", "ovs_interfaceid": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "address": "fa:16:3e:6d:99:f0", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5b9e0c-54", "ovs_interfaceid": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "address": "fa:16:3e:e7:1e:fd", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391aa5f6-f1", "ovs_interfaceid": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "address": "fa:16:3e:67:0e:4f", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50768b8a-11", "ovs_interfaceid": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Received event network-changed-50768b8a-1174-4e18-bce6-764ec39a7d6b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing instance network info cache due to event network-changed-50768b8a-1174-4e18-bce6-764ec39a7d6b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] Acquiring lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] Acquired lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Refreshing network info cache for port 50768b8a-1174-4e18-bce6-764ec39a7d6b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updated VIF entry in instance network info cache for port 50768b8a-1174-4e18-bce6-764ec39a7d6b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [{"id": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "address": "fa:16:3e:eb:22:53", "network": {"id": "514b6a3c-3c91-4b6b-91f4-eca03aa8643f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1864138639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed4704e-0f", "ovs_interfaceid": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "address": "fa:16:3e:b2:b6:6e", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3a14a7-5e", "ovs_interfaceid": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10deb149-79ae-409d-b69d-3d9b74662b72", "address": "fa:16:3e:b1:4e:52", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10deb149-79", "ovs_interfaceid": "10deb149-79ae-409d-b69d-3d9b74662b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "address": "fa:16:3e:03:18:4c", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47bcd3bf-0f", "ovs_interfaceid": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "address": "fa:16:3e:6d:99:f0", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5b9e0c-54", "ovs_interfaceid": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "address": "fa:16:3e:e7:1e:fd", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391aa5f6-f1", "ovs_interfaceid": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "address": "fa:16:3e:67:0e:4f", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50768b8a-11", "ovs_interfaceid": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-510a9f80-5704-42a8-ba11-a7253990116b req-b2626a0c-884c-454f-8540-be8a833a7662 service nova] Releasing lock "refresh_cache-3986f2b4-5e46-4834-9f66-ad5f9a0873bc" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:37:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-96c1f49c-99bf-4b3a-9897-cce17b5f6203 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.803s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lazy-loading 'flavor' on Instance uuid 5e3770a5-16c7-4b7e-8826-ebd2861085b4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'flavor' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6e59410d-c53a-41d0-9d16-e686616da23d tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.650s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1497a02e-4705-48b8-97ad-f4b6ebad8f87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: INFO nova.virt.block_device [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Booting with volume 86f2c87c-0dc1-4d0a-bfb2-ba6658317706 at /dev/vdc
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a6478-fd6f-460e-af85-f659fadd969d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:20 user nova-compute[75288]: INFO nova.compute.manager [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Attaching volume b691374a-5624-47e7-b87c-d3f890a39c6f to /dev/vdb
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[612bada4-1382-444d-a1f7-963a6fda476a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[52673f8b-1c07-45fb-9797-61b6dfc0c7bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:20 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7707e91-c517-4785-95cb-ec0da73085f5]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating existing volume attachment record: a16336af-926a-4644-b961-22dfc11470df {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:20 user nova-compute[75288]: INFO nova.compute.manager [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Attaching volume 74df3c2d-53cb-4eee-af14-5499d8d1ff46 to /dev/vdb
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ea4ddb-99bd-4892-9753-c569522a7054]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc245f2c-20a3-41c3-960e-dbfc179df68f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[542eb78d-9118-4175-a2e1-bf651b1d9b02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9aff31-a172-40ff-921c-d53b4c7d7d8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f86d0-d552-45ab-b36b-cae9ceb47f54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6c09fd-aa6e-4f8a-a723-513523a0e147]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e7531-4ec0-46c5-a87f-0ece8e094bf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:20 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba221f-47ef-4998-9e45-f903d1583753]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f492006-30b0-4ed1-8562-e3ee984622cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating existing volume attachment record: 28406d81-8e19-45f7-af31-a72e0363b13a {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:20 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312bbfa-3baf-4265-b524-f620f58c262a]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating existing volume attachment record: 5560010c-f2d2-46b3-a57f-3bf9e6c0cf38 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:37:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:37:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.495166778564453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 36cfd3ac-5f27-45f6-9e6b-4581b22b533e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 80788251-eb95-4022-8170-d219f083c64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d5b1e547-fd1e-432b-a921-59f3c4702c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7e41f40b-859f-4239-b5e5-a787af7e28ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 3986f2b4-5e46-4834-9f66-ad5f9a0873bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:37:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:37:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:37:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:37:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:37:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:37:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWYZvLqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:26 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:26 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:26 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5ee0d6-d24f-4a8e-8e05-faa23f7145b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:37:26 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76ed72f-ad55-4634-bdfd-31d81cf72fff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047] added
Nov 10 22:37:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd23d25-7500-444b-840b-c2426c2c13bc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97690e7-3290-4dce-b43e-c7b9750f4c71]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWYZvLqS {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWYZvLqS" returned: 0 in 0.038s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ad8a0-1040-4c50-a038-237a5caa6318]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OWYZvLqS'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[21640c5e-0973-4cbd-9af9-ee4d79078570]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd5b11-c845-4533-b25a-a587e7c90446]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:26 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:26 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc36aa-acbe-4751-b9e4-938cbd09b93b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260]
Nov 10 22:37:26 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fde3de-9a4c-46ce-80bb-c35a7eeb13b6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3353d9a6-0589-48d2-abc2-a7be6f1caf81]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:26 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:26 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:26 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:26 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e41391-fedd-4af1-9b30-1478944a5c46]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWYZvLqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23637366137313438', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637366137313438', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lazy-loading 'flavor' on Instance uuid 80788251-eb95-4022-8170-d219f083c64f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:37:27 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:27 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:37:27 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:37:27 user nova-compute[75288]:   <serial>ac32982d-65d5-4e9b-98c3-9d43b45b6047</serial>
Nov 10 22:37:27 user nova-compute[75288]: </disk>
Nov 10 22:37:27 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] No VIF found with MAC fa:16:3e:35:65:5d, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZtjYGbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:29 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:29 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:29 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f07f48a-b510-4715-9150-c1619fc385e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:37:29 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5642356-cca8-48f1-a7e0-118a68c61c34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a] added
Nov 10 22:37:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e949bc57-a720-44fa-9abe-fdc0123fe8a1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[55760aea-77f2-4c91-99ca-7b09c95f8611]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZtjYGbv {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZtjYGbv" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de70a57-0341-41e7-bace-270b2ff09454]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZtjYGbv'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa72ed9-1ffe-47cf-9fc6-c31d898112ac]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9540cd-a909-43ea-bdb6-90724d9ac0cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[671818df-6892-4891-893e-e6b347c19bf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260]
Nov 10 22:37:30 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6353d62-537f-44b3-a1ed-b810e6d03abf]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b37fad-dc29-43b9-be26-331d0929c10d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:30 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[94596f5e-dd42-47b7-a656-c4ffdc40d67a]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZtjYGbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26532646363643064', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532646363643064', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lazy-loading 'flavor' on Instance uuid 7668df42-4bbb-4913-97e7-3b4b67f94eb1 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:37:31 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:31 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:37:31 user nova-compute[75288]:   <target dev="sdc" bus="scsi"/>
Nov 10 22:37:31 user nova-compute[75288]:   <serial>50714c66-b6cb-4cfd-9302-454984cf5d7a</serial>
Nov 10 22:37:31 user nova-compute[75288]:   <address type="drive" controller="0" unit="2"/>
Nov 10 22:37:31 user nova-compute[75288]: </disk>
Nov 10 22:37:31 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] No BDM found with device name sda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] No VIF found with MAC fa:16:3e:cd:70:e2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:37:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG os_brick.utils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5995cd3-8294-4c10-aef7-cd98c5f98fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f86cea-8c8e-4639-8742-3fd252b1d60c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38b1259-1d3d-46ee-8afd-d35755e0d005]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af91bbc-602d-4778-893a-e042325f0818]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:47 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fadfd6-70ef-4a4b-8c5c-f43484aecc80]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG os_brick.utils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Updating existing volume attachment record: 99a617c9-1420-4f10-b993-fad7949990d6 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:47 user nova-compute[75288]: INFO nova.compute.manager [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Terminating instance
Nov 10 22:37:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4f54c224-0477-4b44-a980-60c691eea97e tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.790s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4263d52c-209c-44a5-8d7c-3427bab32c51 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.850s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-38d8aff4-d816-49f2-b18d-4491f7a81129 req-7f27e88b-cdcb-446f-badd-3cf912102f85 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received event network-vif-unplugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38d8aff4-d816-49f2-b18d-4491f7a81129 req-7f27e88b-cdcb-446f-badd-3cf912102f85 service nova] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38d8aff4-d816-49f2-b18d-4491f7a81129 req-7f27e88b-cdcb-446f-badd-3cf912102f85 service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38d8aff4-d816-49f2-b18d-4491f7a81129 req-7f27e88b-cdcb-446f-badd-3cf912102f85 service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-38d8aff4-d816-49f2-b18d-4491f7a81129 req-7f27e88b-cdcb-446f-badd-3cf912102f85 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] No waiting events found dispatching network-vif-unplugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-38d8aff4-d816-49f2-b18d-4491f7a81129 req-7f27e88b-cdcb-446f-badd-3cf912102f85 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received event network-vif-unplugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:37:48 user nova-compute[75288]: INFO nova.virt.block_device [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Booting with volume f87f616f-ee94-412d-9cc5-eb6f2f8cbe98 at /dev/vdb
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a7730df-74ce-4f4c-92be-dc398beac2d5 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a7730df-74ce-4f4c-92be-dc398beac2d5 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7a7730df-74ce-4f4c-92be-dc398beac2d5 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7a7730df-74ce-4f4c-92be-dc398beac2d5 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75288) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7a7730df-74ce-4f4c-92be-dc398beac2d5 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Instance destroyed successfully.
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lazy-loading 'resources' on Instance uuid 36cfd3ac-5f27-45f6-9e6b-4581b22b533e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-591528331',display_name='tempest-DeleteServersTestJSON-server-591528331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-591528331',id=2,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebb5971c1a0740ed8c88bb3985e78ea1',ramdisk_id='',reservation_id='r-kckzpjgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-459072811',owner_user_name='tempest-DeleteServersTestJSON-459072811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:34:43Z,user_data=None,user_id='0b2cda6074654069b7a96c0b62c75834',uuid=36cfd3ac-5f27-45f6-9e6b-4581b22b533e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Converting VIF {"id": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "address": "fa:16:3e:b6:ec:6e", "network": {"id": "0be3a31f-08b2-4e2f-9357-b0ac701ffc3e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-601059072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb5971c1a0740ed8c88bb3985e78ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f25dbf7-23", "ovs_interfaceid": "8f25dbf7-236c-48b3-ac45-5b4c9e285121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ec:6e,bridge_name='br-int',has_traffic_filtering=True,id=8f25dbf7-236c-48b3-ac45-5b4c9e285121,network=Network(0be3a31f-08b2-4e2f-9357-b0ac701ffc3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f25dbf7-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_vif [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ec:6e,bridge_name='br-int',has_traffic_filtering=True,id=8f25dbf7-236c-48b3-ac45-5b4c9e285121,network=Network(0be3a31f-08b2-4e2f-9357-b0ac701ffc3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f25dbf7-23') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f25dbf7-23, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=633039b4-a873-40d7-9b9e-23dea0f3641d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:48 user nova-compute[75288]: INFO os_vif [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ec:6e,bridge_name='br-int',has_traffic_filtering=True,id=8f25dbf7-236c-48b3-ac45-5b4c9e285121,network=Network(0be3a31f-08b2-4e2f-9357-b0ac701ffc3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f25dbf7-23')
Nov 10 22:37:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UENxmnPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:48 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a2f02-8ca7-4da4-b594-d7ee006e257f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:37:48 user nova-compute[75288]: No targets found.
Nov 10 22:37:48 user nova-compute[75288]: iSNS:
Nov 10 22:37:48 user nova-compute[75288]: No targets found.
Nov 10 22:37:48 user nova-compute[75288]: STATIC:
Nov 10 22:37:48 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a
Nov 10 22:37:48 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:37:48 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:37:48 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:37:48 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:37:48 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:37:48 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047
Nov 10 22:37:48 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:37:48 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:37:48 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38
Nov 10 22:37:48 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:37:48 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:37:48 user nova-compute[75288]: FIRMWARE:
Nov 10 22:37:48 user nova-compute[75288]: No targets found.
Nov 10 22:37:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:37:48 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:37:48 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe6432-660a-4881-a048-f76b1e42f123]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58a60c3-4146-4836-8d3b-08270f9af557]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:48 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:48 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:48 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 (non-flash)
Nov 10 22:37:48 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:48 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:48 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b202f81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:37:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d811bb-1a3d-478e-aa9f-63887ebeb306]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bc2033b-bff9-4e14-91e7-93efd41bc126 req-f8487e54-e050-4a24-887d-e2cdaa9c7db1 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bc2033b-bff9-4e14-91e7-93efd41bc126 req-f8487e54-e050-4a24-887d-e2cdaa9c7db1 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bc2033b-bff9-4e14-91e7-93efd41bc126 req-f8487e54-e050-4a24-887d-e2cdaa9c7db1 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bc2033b-bff9-4e14-91e7-93efd41bc126 req-f8487e54-e050-4a24-887d-e2cdaa9c7db1 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bc2033b-bff9-4e14-91e7-93efd41bc126 req-f8487e54-e050-4a24-887d-e2cdaa9c7db1 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:49 user nova-compute[75288]: WARNING nova.compute.manager [req-4bc2033b-bff9-4e14-91e7-93efd41bc126 req-f8487e54-e050-4a24-887d-e2cdaa9c7db1 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state active and task_state powering-off.
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c3588a-0685-49cf-85fb-eadde99e8f72]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ed028-4494-4069-8d7e-b60f115ee831]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ccb165-613d-42b1-9d85-14eb397eccf5]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c283a2c-df33-4f83-9454-bb232631dfbd]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[50252f56-9d64-483a-95dd-ed31f6b439b5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260]
Nov 10 22:37:49 user nova-compute[75288]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b718b5b-cdbc-48ea-a100-8cd3cf7f4e38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[396571de-7a69-48c3-b0ed-2e2337054b59]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] <== disconnect_volume: return (363ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:37:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Deleting instance files /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e_del
Nov 10 22:37:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Deletion of /opt/stack/data/nova/instances/36cfd3ac-5f27-45f6-9e6b-4581b22b533e_del complete
Nov 10 22:37:49 user nova-compute[75288]: INFO nova.compute.manager [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:37:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance destroyed successfully.
Nov 10 22:37:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7a7730df-74ce-4f4c-92be-dc398beac2d5 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:37:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a7730df-74ce-4f4c-92be-dc398beac2d5 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.925s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-81bcb260-5682-4b3c-a779-c69bc825d830 req-e56bde24-9c11-4817-8fc0-b098282b21b7 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received event network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-81bcb260-5682-4b3c-a779-c69bc825d830 req-e56bde24-9c11-4817-8fc0-b098282b21b7 service nova] Acquiring lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-81bcb260-5682-4b3c-a779-c69bc825d830 req-e56bde24-9c11-4817-8fc0-b098282b21b7 service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-81bcb260-5682-4b3c-a779-c69bc825d830 req-e56bde24-9c11-4817-8fc0-b098282b21b7 service nova] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-81bcb260-5682-4b3c-a779-c69bc825d830 req-e56bde24-9c11-4817-8fc0-b098282b21b7 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] No waiting events found dispatching network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:50 user nova-compute[75288]: WARNING nova.compute.manager [req-81bcb260-5682-4b3c-a779-c69bc825d830 req-e56bde24-9c11-4817-8fc0-b098282b21b7 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received unexpected event network-vif-plugged-8f25dbf7-236c-48b3-ac45-5b4c9e285121 for instance with vm_state active and task_state deleting.
Nov 10 22:37:50 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:50 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Took 1.31 seconds to deallocate network for instance.
Nov 10 22:37:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-b7ba9dd5-c356-40f7-9f5e-b93f7280fc35 req-b9f2ec60-29f2-4cde-a82d-9db1f9aa06a2 service nova] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Received event network-vif-deleted-8f25dbf7-236c-48b3-ac45-5b4c9e285121 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-3357e709-28e7-40e4-a051-4e700b67811b req-068ee0ad-8675-491d-b707-1f0a97d557ea service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3357e709-28e7-40e4-a051-4e700b67811b req-068ee0ad-8675-491d-b707-1f0a97d557ea service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3357e709-28e7-40e4-a051-4e700b67811b req-068ee0ad-8675-491d-b707-1f0a97d557ea service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3357e709-28e7-40e4-a051-4e700b67811b req-068ee0ad-8675-491d-b707-1f0a97d557ea service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-3357e709-28e7-40e4-a051-4e700b67811b req-068ee0ad-8675-491d-b707-1f0a97d557ea service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:51 user nova-compute[75288]: WARNING nova.compute.manager [req-3357e709-28e7-40e4-a051-4e700b67811b req-068ee0ad-8675-491d-b707-1f0a97d557ea service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state stopped and task_state None.
Nov 10 22:37:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:37:52 user nova-compute[75288]: INFO nova.compute.claims [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Claim successful on node user
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:37:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.policy [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1839c7b8368947ccacf91af8fd6f0faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01027aba7e1424390b507afbad93f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:37:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Creating image(s)
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk 1073741824" returned: 0 in 0.054s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Successfully created port: 833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Cannot resize image /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Ensure instance console log exists: /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Successfully updated port: 833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquired lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-changed-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Refreshing instance network info cache due to event network-changed-833ea9cc-5b3c-45d9-a790-58a325399f50. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] Acquiring lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:37:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updating instance_info_cache with network_info: [{"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Releasing lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance network_info: |[{"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] Acquired lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Refreshing network info cache for port 833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Start _get_guest_xml network_info=[{"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:37:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:37:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-787401219',display_name='tempest-tempest.common.compute-instance-787401219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-787401219',id=12,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgur9VwcRgcPAddQ2yq2SDKWwkCHOc79qk3MMstyvI4JbzUO7We++xhPD+OI0zsJ8ZIjY2xd7tJ3cZf88cGEqNEfrxS53zEnlcJXT2NxUBnilmBfl9N4p955pTEXCQ+jg==',key_name='tempest-keypair-1131382431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-i8dgfs40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=f9c056b7-56a6-4dd9-972b-7290c27c8fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'pci_devices' on Instance uuid f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:37:54 user nova-compute[75288]:   <uuid>f9c056b7-56a6-4dd9-972b-7290c27c8fcf</uuid>
Nov 10 22:37:54 user nova-compute[75288]:   <name>instance-0000000c</name>
Nov 10 22:37:54 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:37:54 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:37:54 user nova-compute[75288]:   <metadata>
Nov 10 22:37:54 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:37:54 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:37:54 user nova-compute[75288]:       <nova:name>tempest-tempest.common.compute-instance-787401219</nova:name>
Nov 10 22:37:54 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:37:54</nova:creationTime>
Nov 10 22:37:54 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:37:54 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:37:54 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:37:54 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:37:54 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:37:54 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:37:54 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:37:54 user nova-compute[75288]:       <nova:owner>
Nov 10 22:37:54 user nova-compute[75288]:         <nova:user uuid="1839c7b8368947ccacf91af8fd6f0faf">tempest-ServerActionsTestOtherA-1568173136-project-member</nova:user>
Nov 10 22:37:54 user nova-compute[75288]:         <nova:project uuid="d01027aba7e1424390b507afbad93f23">tempest-ServerActionsTestOtherA-1568173136</nova:project>
Nov 10 22:37:54 user nova-compute[75288]:       </nova:owner>
Nov 10 22:37:54 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:37:54 user nova-compute[75288]:       <nova:ports>
Nov 10 22:37:54 user nova-compute[75288]:         <nova:port uuid="833ea9cc-5b3c-45d9-a790-58a325399f50">
Nov 10 22:37:54 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 22:37:54 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:54 user nova-compute[75288]:       </nova:ports>
Nov 10 22:37:54 user nova-compute[75288]:     </nova:instance>
Nov 10 22:37:54 user nova-compute[75288]:   </metadata>
Nov 10 22:37:54 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:37:54 user nova-compute[75288]:     <system>
Nov 10 22:37:54 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:37:54 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:37:54 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:37:54 user nova-compute[75288]:       <entry name="serial">f9c056b7-56a6-4dd9-972b-7290c27c8fcf</entry>
Nov 10 22:37:54 user nova-compute[75288]:       <entry name="uuid">f9c056b7-56a6-4dd9-972b-7290c27c8fcf</entry>
Nov 10 22:37:54 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:37:54 user nova-compute[75288]:     </system>
Nov 10 22:37:54 user nova-compute[75288]:   </sysinfo>
Nov 10 22:37:54 user nova-compute[75288]:   <os>
Nov 10 22:37:54 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:37:54 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:37:54 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:37:54 user nova-compute[75288]:   </os>
Nov 10 22:37:54 user nova-compute[75288]:   <features>
Nov 10 22:37:54 user nova-compute[75288]:     <acpi/>
Nov 10 22:37:54 user nova-compute[75288]:     <apic/>
Nov 10 22:37:54 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:37:54 user nova-compute[75288]:   </features>
Nov 10 22:37:54 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:37:54 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:37:54 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:37:54 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:37:54 user nova-compute[75288]:   </clock>
Nov 10 22:37:54 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:37:54 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:37:54 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:37:54 user nova-compute[75288]:   </cpu>
Nov 10 22:37:54 user nova-compute[75288]:   <devices>
Nov 10 22:37:54 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:37:54 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:37:54 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk"/>
Nov 10 22:37:54 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:37:54 user nova-compute[75288]:     </disk>
Nov 10 22:37:54 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:54 user nova-compute[75288]:       <mac address="fa:16:3e:ef:ad:c3"/>
Nov 10 22:37:54 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:54 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:54 user nova-compute[75288]:       <target dev="tap833ea9cc-5b"/>
Nov 10 22:37:54 user nova-compute[75288]:     </interface>
Nov 10 22:37:54 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:37:54 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/console.log" append="off"/>
Nov 10 22:37:54 user nova-compute[75288]:     </serial>
Nov 10 22:37:54 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:37:54 user nova-compute[75288]:     <video>
Nov 10 22:37:54 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:54 user nova-compute[75288]:     </video>
Nov 10 22:37:54 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:37:54 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:37:54 user nova-compute[75288]:     </rng>
Nov 10 22:37:54 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:37:54 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:37:54 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:37:54 user nova-compute[75288]:     </memballoon>
Nov 10 22:37:54 user nova-compute[75288]:   </devices>
Nov 10 22:37:54 user nova-compute[75288]: </domain>
Nov 10 22:37:54 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-787401219',display_name='tempest-tempest.common.compute-instance-787401219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-787401219',id=12,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgur9VwcRgcPAddQ2yq2SDKWwkCHOc79qk3MMstyvI4JbzUO7We++xhPD+OI0zsJ8ZIjY2xd7tJ3cZf88cGEqNEfrxS53zEnlcJXT2NxUBnilmBfl9N4p955pTEXCQ+jg==',key_name='tempest-keypair-1131382431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-i8dgfs40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=f9c056b7-56a6-4dd9-972b-7290c27c8fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_vif [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32496345-96ac-5d44-9d69-b6d3837f2e0d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap833ea9cc-5b, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap833ea9cc-5b, col_values=(('qos', UUID('0452d022-9664-4a1e-8b82-f4366a49ef7a')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap833ea9cc-5b, col_values=(('external_ids', {'iface-id': '833ea9cc-5b3c-45d9-a790-58a325399f50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:ad:c3', 'vm-uuid': 'f9c056b7-56a6-4dd9-972b-7290c27c8fcf'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:54 user nova-compute[75288]: INFO os_vif [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b')
Nov 10 22:37:54 user nova-compute[75288]: INFO nova.compute.manager [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] [instance: 36cfd3ac-5f27-45f6-9e6b-4581b22b533e] Took 3.80 seconds to detach 1 volumes for instance.
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No VIF found with MAC fa:16:3e:ef:ad:c3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.utils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f135b909-067c-45d5-aaea-31c7de0c0250]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28202b-ed1f-4463-af85-7936664c4dd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[599655e5-5892-47f2-b427-f48d05ed463e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[20619b68-a633-449f-b0c8-f55a739601b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:37:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Creating image(s)
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Ensure instance console log exists: /opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Start _get_guest_xml network_info=[{"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdZEFVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e41f40b-859f-4239-b5e5-a787af7e28ad', 'attached_at': '', 'detached_at': '', 'volume_id': '00a82c99-40d3-48ed-a341-dda7d1603f07', 'serial': '00a82c99-40d3-48ed-a341-dda7d1603f07'}, 'mount_device': '/dev/vda', 'attachment_id': '704488a3-8ce0-46c6-8c54-475b5228f01c', 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHLilNVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e41f40b-859f-4239-b5e5-a787af7e28ad', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8af8288-08e0-4e1c-aa78-9621d9222e7d', 'serial': 'f8af8288-08e0-4e1c-aa78-9621d9222e7d'}, 'mount_device': '/dev/vdb', 'attachment_id': '66fc0190-5b4a-4eeb-8134-f5f58ce690b4', 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvfxVIka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e41f40b-859f-4239-b5e5-a787af7e28ad', 'attached_at': '', 'detached_at': '', 'volume_id': '86f2c87c-0dc1-4d0a-bfb2-ba6658317706', 'serial': '86f2c87c-0dc1-4d0a-bfb2-ba6658317706'}, 'mount_device': '/dev/vdc', 'attachment_id': '28406d81-8e19-45f7-af31-a72e0363b13a', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:37:54 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c7ef9-e346-4c07-9245-130790086599]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.utils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating existing volume attachment record: ecd9c5e5-039a-47de-8521-23c9afdd7263 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:37:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:37:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdZEFVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:54 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updated VIF entry in instance network info cache for port 833ea9cc-5b3c-45d9-a790-58a325399f50. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updating instance_info_cache with network_info: [{"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eff07a-0432-4c02-8231-1debea2de8cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:37:54 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b27cb640-d603-4fb9-ad39-a9ef808b0b5d req-96719723-db69-43b2-b7aa-edb74c7f6ba4 service nova] Releasing lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6ff565-5636-4293-a4d9-20eecdfc3e15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07] added
Nov 10 22:37:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[88284d10-6103-446f-a461-d38d8238a246]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86536615-115c-4462-bdce-502e722cae53]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxdZEFVl {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxdZEFVl" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3cda7c-3ece-438a-b32d-af0b0a281f88]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxdZEFVl'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef6b997-7b43-4b34-9b44-1ae0ee8c9231]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da87cf99-e56d-4650-8ec6-a8d0cdc6b670]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:54 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:54 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:54 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:54 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42445e9-e059-4f0b-b6d4-c0fa69b98cc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260]
Nov 10 22:37:55 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.571s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb4f14a-d3e5-4873-92e2-d646e3581c62]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:55 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Deleted allocations for instance 36cfd3ac-5f27-45f6-9e6b-4581b22b533e
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77509eb5-a636-4b01-ac65-a9d26dcaf4fb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:55 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:55 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:55 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:55 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:55 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:55 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5770d-7132-4092-a244-2a88878a2291]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdZEFVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33059402-7caa-4cf6-88de-3619b8a9f615 tempest-DeleteServersTestJSON-459072811 tempest-DeleteServersTestJSON-459072811-project-member] Lock "36cfd3ac-5f27-45f6-9e6b-4581b22b533e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.293s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-92083916-72e0-463e-a512-d039b53619e3 req-04eff5b7-95ef-44e3-a047-e859da438d63 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92083916-72e0-463e-a512-d039b53619e3 req-04eff5b7-95ef-44e3-a047-e859da438d63 service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92083916-72e0-463e-a512-d039b53619e3 req-04eff5b7-95ef-44e3-a047-e859da438d63 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92083916-72e0-463e-a512-d039b53619e3 req-04eff5b7-95ef-44e3-a047-e859da438d63 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-92083916-72e0-463e-a512-d039b53619e3 req-04eff5b7-95ef-44e3-a047-e859da438d63 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:56 user nova-compute[75288]: WARNING nova.compute.manager [req-92083916-72e0-463e-a512-d039b53619e3 req-04eff5b7-95ef-44e3-a047-e859da438d63 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received unexpected event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with vm_state building and task_state spawning.
Nov 10 22:37:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23831313563323234', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831313563323234', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHLilNVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:56 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998bca8-c2a3-46d0-b806-84f929aded7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:37:56 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a12809-2c12-4ad7-9b6c-166dbf5c9eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d] added
Nov 10 22:37:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddbe839-a950-4c86-965f-c0e86a8c911b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[263c3008-5bcc-45fa-88de-3be1454ce59a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHLilNVt {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHLilNVt" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7aa8a4-a583-47d8-9ee0-4d57fd860771]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sHLilNVt'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ee6d40-d15c-4e24-8570-56fb7551b422]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[115fc957-1a34-4fd6-91b2-de56dd7ecef5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cbe2dd-1f2d-4e03-ad0b-46cccbd61821]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260]
Nov 10 22:37:56 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcf6575-b491-4f52-a04f-5ec20b4b8719]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f02482c-e84b-4fe2-9611-0b19fd4e357b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:56 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7080f9d-29b1-48af-8eee-230a01864008]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHLilNVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23733373364366536', 'path': '/dev/sdf'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733373364366536', 'path': '/dev/sdf'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvfxVIka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:57 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[272a675a-71fa-40f6-9a24-32c6215563ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:37:57 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[706598d4-f7dd-427a-b349-65feb54252f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706] added
Nov 10 22:37:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a0a71a-0b76-4adc-81c1-a9e70c10c88e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f0bf4c-9322-4eaa-abc8-3996cdc78548]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mvfxVIka {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mvfxVIka" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f4441-09e7-4876-8b45-d97d210db195]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mvfxVIka'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad59a538-2998-4582-96c4-43af8b915468]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807d651-e081-4493-8606-4c8a214a8b16]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c54cd7-cbbe-4a50-a377-419d5429a139]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260]
Nov 10 22:37:57 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c926b4df-d83e-450b-8ca8-9d5b21eedadc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2bdedc-3cca-4e5c-8982-e25d1d0a1e8d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:57 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:37:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27cc878-2cf8-4624-b4bc-d4053823679b]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvfxVIka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:37:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance spawned successfully.
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:37:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZFfLSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:37:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:58 user nova-compute[75288]: INFO nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-e567556a-fc97-4bc2-ad25-0278f0a4efbb req-d69a0c31-8d17-4a90-9be3-9954b0762686 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e567556a-fc97-4bc2-ad25-0278f0a4efbb req-d69a0c31-8d17-4a90-9be3-9954b0762686 service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e567556a-fc97-4bc2-ad25-0278f0a4efbb req-d69a0c31-8d17-4a90-9be3-9954b0762686 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e567556a-fc97-4bc2-ad25-0278f0a4efbb req-d69a0c31-8d17-4a90-9be3-9954b0762686 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-e567556a-fc97-4bc2-ad25-0278f0a4efbb req-d69a0c31-8d17-4a90-9be3-9954b0762686 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:37:58 user nova-compute[75288]: WARNING nova.compute.manager [req-e567556a-fc97-4bc2-ad25-0278f0a4efbb req-d69a0c31-8d17-4a90-9be3-9954b0762686 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received unexpected event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with vm_state building and task_state spawning.
Nov 10 22:37:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:58 user nova-compute[75288]: INFO nova.compute.manager [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Took 6.23 seconds to build instance.
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6721f163-db1d-4705-a38e-be1f4a0688b0 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.327s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:58 user nova-compute[75288]: INFO nova.compute.manager [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Detaching volume 50714c66-b6cb-4cfd-9302-454984cf5d7a
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23035373761653331', 'path': '/dev/sdg'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035373761653331', 'path': '/dev/sdg'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.855s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:37:58 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[87223fad-1f3a-4602-a76c-d2355934f93a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:37:58 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:78:af,bridge_name='br-int',has_traffic_filtering=True,id=dc7936a1-6060-4ea8-bc0a-d03a995b2902,network=Network(f2113043-a019-4638-9677-3436e37f4634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7936a1-60') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:01:17,bridge_name='br-int',has_traffic_filtering=True,id=bcebe502-3e3e-486a-a332-f3679a175811,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcebe502-3e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ad:36,bridge_name='br-int',has_traffic_filtering=True,id=f198f762-e7ad-4362-85ad-735538cf8b1c,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf198f762-e7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:36:19,bridge_name='br-int',has_traffic_filtering=True,id=3aa2573a-fa2d-4ca9-adc1-36c5b17b7785,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aa2573a-fa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:51,bridge_name='br-int',has_traffic_filtering=True,id=5acd3810-8cbd-425f-af05-8e33cdfa9e5a,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acd3810-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:a7,bridge_name='br-int',has_traffic_filtering=True,id=7bf243a0-ae7b-49c7-a602-680b5621df79,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf243a0-ae') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e3:de,bridge_name='br-int',has_traffic_filtering=True,id=371a03ef-3889-464c-a07a-7a9e5e30ddd5,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371a03ef-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e41f40b-859f-4239-b5e5-a787af7e28ad {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbbdf58-078d-4dab-b922-0b9ce34fdaeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f] added
Nov 10 22:37:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:37:58 user nova-compute[75288]:   <uuid>7e41f40b-859f-4239-b5e5-a787af7e28ad</uuid>
Nov 10 22:37:58 user nova-compute[75288]:   <name>instance-0000000a</name>
Nov 10 22:37:58 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:37:58 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:37:58 user nova-compute[75288]:   <metadata>
Nov 10 22:37:58 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:37:58 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:37:58 user nova-compute[75288]:       <nova:name>tempest-device-tagging-server-846737018</nova:name>
Nov 10 22:37:58 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:37:54</nova:creationTime>
Nov 10 22:37:58 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:37:58 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:37:58 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:37:58 user nova-compute[75288]:       <nova:owner>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:user uuid="09aff48c3ed14ceda87ced776db66878">tempest-TaggedBootDevicesTest-793515078-project-member</nova:user>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:project uuid="36d9c346e8b64225b46aff84560ee0f2">tempest-TaggedBootDevicesTest-793515078</nova:project>
Nov 10 22:37:58 user nova-compute[75288]:       </nova:owner>
Nov 10 22:37:58 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:37:58 user nova-compute[75288]:       <nova:ports>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:port uuid="dc7936a1-6060-4ea8-bc0a-d03a995b2902">
Nov 10 22:37:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 22:37:58 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:port uuid="bcebe502-3e3e-486a-a332-f3679a175811">
Nov 10 22:37:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Nov 10 22:37:58 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:port uuid="f198f762-e7ad-4362-85ad-735538cf8b1c">
Nov 10 22:37:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 10 22:37:58 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:port uuid="3aa2573a-fa2d-4ca9-adc1-36c5b17b7785">
Nov 10 22:37:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 10 22:37:58 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:port uuid="5acd3810-8cbd-425f-af05-8e33cdfa9e5a">
Nov 10 22:37:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.21" ipVersion="4"/>
Nov 10 22:37:58 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:port uuid="7bf243a0-ae7b-49c7-a602-680b5621df79">
Nov 10 22:37:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 22:37:58 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:58 user nova-compute[75288]:         <nova:port uuid="371a03ef-3889-464c-a07a-7a9e5e30ddd5">
Nov 10 22:37:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 22:37:58 user nova-compute[75288]:         </nova:port>
Nov 10 22:37:58 user nova-compute[75288]:       </nova:ports>
Nov 10 22:37:58 user nova-compute[75288]:     </nova:instance>
Nov 10 22:37:58 user nova-compute[75288]:   </metadata>
Nov 10 22:37:58 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:37:58 user nova-compute[75288]:     <system>
Nov 10 22:37:58 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:37:58 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:37:58 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:37:58 user nova-compute[75288]:       <entry name="serial">7e41f40b-859f-4239-b5e5-a787af7e28ad</entry>
Nov 10 22:37:58 user nova-compute[75288]:       <entry name="uuid">7e41f40b-859f-4239-b5e5-a787af7e28ad</entry>
Nov 10 22:37:58 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:37:58 user nova-compute[75288]:     </system>
Nov 10 22:37:58 user nova-compute[75288]:   </sysinfo>
Nov 10 22:37:58 user nova-compute[75288]:   <os>
Nov 10 22:37:58 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:37:58 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:37:58 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:37:58 user nova-compute[75288]:   </os>
Nov 10 22:37:58 user nova-compute[75288]:   <features>
Nov 10 22:37:58 user nova-compute[75288]:     <acpi/>
Nov 10 22:37:58 user nova-compute[75288]:     <apic/>
Nov 10 22:37:58 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:37:58 user nova-compute[75288]:   </features>
Nov 10 22:37:58 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:37:58 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:37:58 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:37:58 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:37:58 user nova-compute[75288]:   </clock>
Nov 10 22:37:58 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:37:58 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:37:58 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:37:58 user nova-compute[75288]:   </cpu>
Nov 10 22:37:58 user nova-compute[75288]:   <devices>
Nov 10 22:37:58 user nova-compute[75288]:     <disk type="file" device="cdrom">
Nov 10 22:37:58 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 22:37:58 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad/disk.config"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="hda" bus="ide"/>
Nov 10 22:37:58 user nova-compute[75288]:     </disk>
Nov 10 22:37:58 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:37:58 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:58 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <serial>00a82c99-40d3-48ed-a341-dda7d1603f07</serial>
Nov 10 22:37:58 user nova-compute[75288]:     </disk>
Nov 10 22:37:58 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:37:58 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:58 user nova-compute[75288]:       <source dev="/dev/sdf"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <serial>f8af8288-08e0-4e1c-aa78-9621d9222e7d</serial>
Nov 10 22:37:58 user nova-compute[75288]:     </disk>
Nov 10 22:37:58 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:37:58 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:58 user nova-compute[75288]:       <source dev="/dev/sdg"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="vdc" bus="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <serial>86f2c87c-0dc1-4d0a-bfb2-ba6658317706</serial>
Nov 10 22:37:58 user nova-compute[75288]:     </disk>
Nov 10 22:37:58 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:58 user nova-compute[75288]:       <mac address="fa:16:3e:a7:78:af"/>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="tapdc7936a1-60"/>
Nov 10 22:37:58 user nova-compute[75288]:     </interface>
Nov 10 22:37:58 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:58 user nova-compute[75288]:       <mac address="fa:16:3e:f4:01:17"/>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="tapbcebe502-3e"/>
Nov 10 22:37:58 user nova-compute[75288]:     </interface>
Nov 10 22:37:58 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:58 user nova-compute[75288]:       <mac address="fa:16:3e:60:ad:36"/>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="tapf198f762-e7"/>
Nov 10 22:37:58 user nova-compute[75288]:     </interface>
Nov 10 22:37:58 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:58 user nova-compute[75288]:       <mac address="fa:16:3e:9f:36:19"/>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="tap3aa2573a-fa"/>
Nov 10 22:37:58 user nova-compute[75288]:     </interface>
Nov 10 22:37:58 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:58 user nova-compute[75288]:       <mac address="fa:16:3e:6f:b8:51"/>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="tap5acd3810-8c"/>
Nov 10 22:37:58 user nova-compute[75288]:     </interface>
Nov 10 22:37:58 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:58 user nova-compute[75288]:       <mac address="fa:16:3e:fb:20:a7"/>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="tap7bf243a0-ae"/>
Nov 10 22:37:58 user nova-compute[75288]:     </interface>
Nov 10 22:37:58 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:37:58 user nova-compute[75288]:       <mac address="fa:16:3e:ae:e3:de"/>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:37:58 user nova-compute[75288]:       <target dev="tap371a03ef-38"/>
Nov 10 22:37:58 user nova-compute[75288]:     </interface>
Nov 10 22:37:58 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:37:58 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad/console.log" append="off"/>
Nov 10 22:37:58 user nova-compute[75288]:     </serial>
Nov 10 22:37:58 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:37:58 user nova-compute[75288]:     <video>
Nov 10 22:37:58 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:37:58 user nova-compute[75288]:     </video>
Nov 10 22:37:58 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:37:58 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:37:58 user nova-compute[75288]:     </rng>
Nov 10 22:37:58 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:37:58 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:37:58 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:37:58 user nova-compute[75288]:     </memballoon>
Nov 10 22:37:58 user nova-compute[75288]:   </devices>
Nov 10 22:37:58 user nova-compute[75288]: </domain>
Nov 10 22:37:58 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:78:af,bridge_name='br-int',has_traffic_filtering=True,id=dc7936a1-6060-4ea8-bc0a-d03a995b2902,network=Network(f2113043-a019-4638-9677-3436e37f4634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7936a1-60') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:78:af,bridge_name='br-int',has_traffic_filtering=True,id=dc7936a1-6060-4ea8-bc0a-d03a995b2902,network=Network(f2113043-a019-4638-9677-3436e37f4634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7936a1-60') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68af9a72-d999-5630-851f-76e91cddc811', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6512863c-4700-4201-9b1b-e475a1167cac]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc7936a1-60, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc7936a1-60, col_values=(('qos', UUID('40fe8b56-eac0-4db2-97fa-c04669baffe1')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc7936a1-60, col_values=(('external_ids', {'iface-id': 'dc7936a1-6060-4ea8-bc0a-d03a995b2902', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:78:af', 'vm-uuid': '7e41f40b-859f-4239-b5e5-a787af7e28ad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84bf7f3-6673-47aa-9d2c-3c179d19cfb4]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZFfLSDY {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: INFO os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:78:af,bridge_name='br-int',has_traffic_filtering=True,id=dc7936a1-6060-4ea8-bc0a-d03a995b2902,network=Network(f2113043-a019-4638-9677-3436e37f4634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7936a1-60')
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:01:17,bridge_name='br-int',has_traffic_filtering=True,id=bcebe502-3e3e-486a-a332-f3679a175811,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcebe502-3e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:01:17,bridge_name='br-int',has_traffic_filtering=True,id=bcebe502-3e3e-486a-a332-f3679a175811,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcebe502-3e') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2d99a36-2737-5ebc-82c1-3f23d8225ed4', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vZFfLSDY" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73fab3e-f175-4a1f-b55e-db32d8c55fa5]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vZFfLSDY'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcebe502-3e, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcebe502-3e, col_values=(('qos', UUID('cd13c69e-2acc-49bc-834b-ec2674bd00f0')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcebe502-3e, col_values=(('external_ids', {'iface-id': 'bcebe502-3e3e-486a-a332-f3679a175811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:01:17', 'vm-uuid': '7e41f40b-859f-4239-b5e5-a787af7e28ad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade901a2-7ae2-4698-9bd1-0ffe271c41da]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: INFO os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:01:17,bridge_name='br-int',has_traffic_filtering=True,id=bcebe502-3e3e-486a-a332-f3679a175811,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcebe502-3e')
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ad:36,bridge_name='br-int',has_traffic_filtering=True,id=f198f762-e7ad-4362-85ad-735538cf8b1c,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf198f762-e7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ad:36,bridge_name='br-int',has_traffic_filtering=True,id=f198f762-e7ad-4362-85ad-735538cf8b1c,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf198f762-e7') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8eb782-f2b0-46d6-bae5-2161417a12f6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '365bf895-cbc2-5ebd-8af1-eb1fe629a790', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf198f762-e7, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf198f762-e7, col_values=(('qos', UUID('f111d446-ba7a-498b-80ba-28f007d93a29')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf198f762-e7, col_values=(('external_ids', {'iface-id': 'f198f762-e7ad-4362-85ad-735538cf8b1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:ad:36', 'vm-uuid': '7e41f40b-859f-4239-b5e5-a787af7e28ad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: INFO os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ad:36,bridge_name='br-int',has_traffic_filtering=True,id=f198f762-e7ad-4362-85ad-735538cf8b1c,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf198f762-e7')
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:36:19,bridge_name='br-int',has_traffic_filtering=True,id=3aa2573a-fa2d-4ca9-adc1-36c5b17b7785,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aa2573a-fa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:36:19,bridge_name='br-int',has_traffic_filtering=True,id=3aa2573a-fa2d-4ca9-adc1-36c5b17b7785,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aa2573a-fa') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '243f694a-5a28-5c24-8373-8f0be6bf3b9e', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: INFO nova.compute.manager [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Detaching volume ac32982d-65d5-4e9b-98c3-9d43b45b6047
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f4b28c-6c8a-4c48-bf03-33e2749b48b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260]
Nov 10 22:37:59 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260] successful.
Nov 10 22:37:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b288eed7-c49f-4c30-ab85-a9436f206dc2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3aa2573a-fa, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3aa2573a-fa, col_values=(('qos', UUID('4ea181fb-e17a-4187-93ab-df03349df373')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3aa2573a-fa, col_values=(('external_ids', {'iface-id': '3aa2573a-fa2d-4ca9-adc1-36c5b17b7785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:36:19', 'vm-uuid': '7e41f40b-859f-4239-b5e5-a787af7e28ad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: INFO nova.virt.block_device [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Attempting to driver detach volume 50714c66-b6cb-4cfd-9302-454984cf5d7a from mountpoint /dev/sdc
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f614b-1a83-46bb-8f65-26ed9f5360aa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:37:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:37:59 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:37:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Attempting to detach device sdc from instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:37:59 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:59 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:37:59 user nova-compute[75288]:   <target dev="sdc" bus="scsi"/>
Nov 10 22:37:59 user nova-compute[75288]:   <serial>50714c66-b6cb-4cfd-9302-454984cf5d7a</serial>
Nov 10 22:37:59 user nova-compute[75288]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 22:37:59 user nova-compute[75288]: </disk>
Nov 10 22:37:59 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:37:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Successfully detached device sdc from instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 from the persistent domain config.
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:37:59 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:59 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:37:59 user nova-compute[75288]:   <target dev="sdc" bus="scsi"/>
Nov 10 22:37:59 user nova-compute[75288]:   <serial>50714c66-b6cb-4cfd-9302-454984cf5d7a</serial>
Nov 10 22:37:59 user nova-compute[75288]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 22:37:59 user nova-compute[75288]: </disk>
Nov 10 22:37:59 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: INFO os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:36:19,bridge_name='br-int',has_traffic_filtering=True,id=3aa2573a-fa2d-4ca9-adc1-36c5b17b7785,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aa2573a-fa')
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:51,bridge_name='br-int',has_traffic_filtering=True,id=5acd3810-8cbd-425f-af05-8e33cdfa9e5a,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acd3810-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:51,bridge_name='br-int',has_traffic_filtering=True,id=5acd3810-8cbd-425f-af05-8e33cdfa9e5a,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acd3810-8c') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0d852f-9130-4957-9468-c14cf4a5ee25]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZFfLSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b853318-4c09-50c2-82dc-05f91552d02a', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5acd3810-8c, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5acd3810-8c, col_values=(('qos', UUID('49f76a5e-f2d2-4670-8a93-be527a30b24c')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5acd3810-8c, col_values=(('external_ids', {'iface-id': '5acd3810-8cbd-425f-af05-8e33cdfa9e5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:b8:51', 'vm-uuid': '7e41f40b-859f-4239-b5e5-a787af7e28ad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: INFO os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:51,bridge_name='br-int',has_traffic_filtering=True,id=5acd3810-8cbd-425f-af05-8e33cdfa9e5a,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acd3810-8c')
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:a7,bridge_name='br-int',has_traffic_filtering=True,id=7bf243a0-ae7b-49c7-a602-680b5621df79,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf243a0-ae') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:a7,bridge_name='br-int',has_traffic_filtering=True,id=7bf243a0-ae7b-49c7-a602-680b5621df79,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf243a0-ae') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:59 user nova-compute[75288]: INFO nova.virt.block_device [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Attempting to driver detach volume ac32982d-65d5-4e9b-98c3-9d43b45b6047 from mountpoint /dev/vdb
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bb94467-ac06-579d-9f8c-68c400eece9b', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Attempting to detach device vdb from instance 80788251-eb95-4022-8170-d219f083c64f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:37:59 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:59 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:37:59 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:37:59 user nova-compute[75288]:   <serial>ac32982d-65d5-4e9b-98c3-9d43b45b6047</serial>
Nov 10 22:37:59 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:37:59 user nova-compute[75288]: </disk>
Nov 10 22:37:59 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:37:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Successfully detached device vdb from instance 80788251-eb95-4022-8170-d219f083c64f from the persistent domain config.
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80788251-eb95-4022-8170-d219f083c64f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:37:59 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:37:59 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:37:59 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:37:59 user nova-compute[75288]:   <serial>ac32982d-65d5-4e9b-98c3-9d43b45b6047</serial>
Nov 10 22:37:59 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:37:59 user nova-compute[75288]: </disk>
Nov 10 22:37:59 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bf243a0-ae, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bf243a0-ae, col_values=(('qos', UUID('2b009439-eea2-410c-8294-65b09c90271e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bf243a0-ae, col_values=(('external_ids', {'iface-id': '7bf243a0-ae7b-49c7-a602-680b5621df79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:20:a7', 'vm-uuid': '7e41f40b-859f-4239-b5e5-a787af7e28ad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: INFO os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:a7,bridge_name='br-int',has_traffic_filtering=True,id=7bf243a0-ae7b-49c7-a602-680b5621df79,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf243a0-ae')
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e3:de,bridge_name='br-int',has_traffic_filtering=True,id=371a03ef-3889-464c-a07a-7a9e5e30ddd5,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371a03ef-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e3:de,bridge_name='br-int',has_traffic_filtering=True,id=371a03ef-3889-464c-a07a-7a9e5e30ddd5,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371a03ef-38') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e989b513-5388-5020-961f-63ee5fc3823d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap371a03ef-38, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap371a03ef-38, col_values=(('qos', UUID('ec98a81d-2f17-45fd-8a53-e05d822a5618')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap371a03ef-38, col_values=(('external_ids', {'iface-id': '371a03ef-3889-464c-a07a-7a9e5e30ddd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:e3:de', 'vm-uuid': '7e41f40b-859f-4239-b5e5-a787af7e28ad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:37:59 user nova-compute[75288]: INFO os_vif [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e3:de,bridge_name='br-int',has_traffic_filtering=True,id=371a03ef-3889-464c-a07a-7a9e5e30ddd5,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371a03ef-38')
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] No VIF found with MAC fa:16:3e:a7:78:af, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:37:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] No VIF found with MAC fa:16:3e:6f:b8:51, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:37:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Using config drive
Nov 10 22:38:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80788251-eb95-4022-8170-d219f083c64f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:38:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Creating config drive at /opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad/disk.config
Nov 10 22:38:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpclfzkn3a {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpclfzkn3a" returned: 0 in 0.062s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:38:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] <== connect_volume: return (2337ms) {'type': 'block', 'scsi_wwn': '26664313934346663', 'path': '/dev/sdh'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664313934346663', 'path': '/dev/sdh'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:38:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'flavor' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:38:00 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:38:00 user nova-compute[75288]:   <source dev="/dev/sdh"/>
Nov 10 22:38:00 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:38:00 user nova-compute[75288]:   <serial>b691374a-5624-47e7-b87c-d3f890a39c6f</serial>
Nov 10 22:38:00 user nova-compute[75288]: </disk>
Nov 10 22:38:00 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:38:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:38:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:38:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] No VIF found with MAC fa:16:3e:2c:d0:b2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:38:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1454061-a848-46b2-9045-9eed3b88e829 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.567s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b2883b1-2f74-4c04-81a7-8f7ff330a668 req-a8606bec-ff2b-479b-af67-1c4fec9f1e6e service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b2883b1-2f74-4c04-81a7-8f7ff330a668 req-a8606bec-ff2b-479b-af67-1c4fec9f1e6e service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b2883b1-2f74-4c04-81a7-8f7ff330a668 req-a8606bec-ff2b-479b-af67-1c4fec9f1e6e service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b2883b1-2f74-4c04-81a7-8f7ff330a668 req-a8606bec-ff2b-479b-af67-1c4fec9f1e6e service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b2883b1-2f74-4c04-81a7-8f7ff330a668 req-a8606bec-ff2b-479b-af67-1c4fec9f1e6e service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:02 user nova-compute[75288]: WARNING nova.compute.manager [req-4b2883b1-2f74-4c04-81a7-8f7ff330a668 req-a8606bec-ff2b-479b-af67-1c4fec9f1e6e service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 for instance with vm_state building and task_state spawning.
Nov 10 22:38:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-af477c01-96c3-4ab3-affe-9daac2381197 req-ba66e6f4-f207-48e9-953c-47f810c9252b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af477c01-96c3-4ab3-affe-9daac2381197 req-ba66e6f4-f207-48e9-953c-47f810c9252b service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af477c01-96c3-4ab3-affe-9daac2381197 req-ba66e6f4-f207-48e9-953c-47f810c9252b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af477c01-96c3-4ab3-affe-9daac2381197 req-ba66e6f4-f207-48e9-953c-47f810c9252b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-af477c01-96c3-4ab3-affe-9daac2381197 req-ba66e6f4-f207-48e9-953c-47f810c9252b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:03 user nova-compute[75288]: WARNING nova.compute.manager [req-af477c01-96c3-4ab3-affe-9daac2381197 req-ba66e6f4-f207-48e9-953c-47f810c9252b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 for instance with vm_state building and task_state spawning.
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:04 user nova-compute[75288]: INFO nova.compute.manager [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Detaching volume b691374a-5624-47e7-b87c-d3f890a39c6f
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: INFO nova.virt.block_device [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Attempting to driver detach volume b691374a-5624-47e7-b87c-d3f890a39c6f from mountpoint /dev/vdb
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Attempting to detach device vdb from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:38:04 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:38:04 user nova-compute[75288]:   <source dev="/dev/sdh"/>
Nov 10 22:38:04 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:38:04 user nova-compute[75288]:   <serial>b691374a-5624-47e7-b87c-d3f890a39c6f</serial>
Nov 10 22:38:04 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 22:38:04 user nova-compute[75288]: </disk>
Nov 10 22:38:04 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:38:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully detached device vdb from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the persistent domain config.
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:38:04 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:38:04 user nova-compute[75288]:   <source dev="/dev/sdh"/>
Nov 10 22:38:04 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:38:04 user nova-compute[75288]:   <serial>b691374a-5624-47e7-b87c-d3f890a39c6f</serial>
Nov 10 22:38:04 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 22:38:04 user nova-compute[75288]: </disk>
Nov 10 22:38:04 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-9b61e0c3-0a47-4201-abf8-2fdb0f3f7759 req-b8fb5450-f238-495d-a5af-6bb157bb254b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9b61e0c3-0a47-4201-abf8-2fdb0f3f7759 req-b8fb5450-f238-495d-a5af-6bb157bb254b service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9b61e0c3-0a47-4201-abf8-2fdb0f3f7759 req-b8fb5450-f238-495d-a5af-6bb157bb254b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9b61e0c3-0a47-4201-abf8-2fdb0f3f7759 req-b8fb5450-f238-495d-a5af-6bb157bb254b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-9b61e0c3-0a47-4201-abf8-2fdb0f3f7759 req-b8fb5450-f238-495d-a5af-6bb157bb254b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:04 user nova-compute[75288]: WARNING nova.compute.manager [req-9b61e0c3-0a47-4201-abf8-2fdb0f3f7759 req-b8fb5450-f238-495d-a5af-6bb157bb254b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 for instance with vm_state building and task_state spawning.
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:04 user nova-compute[75288]: WARNING nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 for instance with vm_state building and task_state spawning.
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:04 user nova-compute[75288]: WARNING nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 for instance with vm_state building and task_state spawning.
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:04 user nova-compute[75288]: WARNING nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 for instance with vm_state building and task_state spawning.
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:04 user nova-compute[75288]: WARNING nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c for instance with vm_state building and task_state spawning.
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:04 user nova-compute[75288]: WARNING nova.compute.manager [req-4955deaa-1bcc-41a6-a7d1-c657ae850f23 req-a5130981-0ada-4326-b92d-64bed1e52a65 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c for instance with vm_state building and task_state spawning.
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:05 user nova-compute[75288]: WARNING nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 for instance with vm_state building and task_state spawning.
Nov 10 22:38:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:05 user nova-compute[75288]: WARNING nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a for instance with vm_state building and task_state spawning.
Nov 10 22:38:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:05 user nova-compute[75288]: WARNING nova.compute.manager [req-7be2e489-e72b-4941-a66c-1c514fbb1f79 req-b5c7fdd1-eee7-4351-b1f8-562d0aa0e5b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a for instance with vm_state building and task_state spawning.
Nov 10 22:38:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:06 user nova-compute[75288]: WARNING nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 for instance with vm_state building and task_state spawning.
Nov 10 22:38:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:06 user nova-compute[75288]: WARNING nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 for instance with vm_state building and task_state spawning.
Nov 10 22:38:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:06 user nova-compute[75288]: WARNING nova.compute.manager [req-56b6a250-31c9-42b0-b7ce-f86990e964ac req-69f71324-3db2-472e-8e06-3a69f45e41dc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 for instance with vm_state building and task_state spawning.
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:38:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance spawned successfully.
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:07 user nova-compute[75288]: INFO nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Took 13.30 seconds to spawn the instance on the hypervisor.
Nov 10 22:38:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:38:08 user nova-compute[75288]: INFO nova.compute.manager [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Took 108.98 seconds to build instance.
Nov 10 22:38:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cad4be57-25cc-4653-9996-16b40d186043 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 109.123s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "f2b08056-0591-41d9-aad4-76f759b3751f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f2b08056-0591-41d9-aad4-76f759b3751f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:38:14 user nova-compute[75288]: INFO nova.compute.claims [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Claim successful on node user
Nov 10 22:38:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:38:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:38:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:38:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:38:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:38:15 user nova-compute[75288]: DEBUG nova.policy [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07d1ae0425e64057b3b2220d4bb02624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4325393aa3434c2a87912895d4574812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:38:15 user nova-compute[75288]: INFO nova.virt.block_device [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Booting with blank volume at /dev/vda
Nov 10 22:38:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Successfully created port: aefd1a4f-3f70-439c-8308-16e34d47e985 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Successfully updated port: aefd1a4f-3f70-439c-8308-16e34d47e985 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "refresh_cache-f2b08056-0591-41d9-aad4-76f759b3751f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquired lock "refresh_cache-f2b08056-0591-41d9-aad4-76f759b3751f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Received event network-changed-aefd1a4f-3f70-439c-8308-16e34d47e985 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Refreshing instance network info cache due to event network-changed-aefd1a4f-3f70-439c-8308-16e34d47e985. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] Acquiring lock "refresh_cache-f2b08056-0591-41d9-aad4-76f759b3751f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Updating instance_info_cache with network_info: [{"id": "aefd1a4f-3f70-439c-8308-16e34d47e985", "address": "fa:16:3e:c6:77:b8", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefd1a4f-3f", "ovs_interfaceid": "aefd1a4f-3f70-439c-8308-16e34d47e985", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Releasing lock "refresh_cache-f2b08056-0591-41d9-aad4-76f759b3751f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Instance network_info: |[{"id": "aefd1a4f-3f70-439c-8308-16e34d47e985", "address": "fa:16:3e:c6:77:b8", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefd1a4f-3f", "ovs_interfaceid": "aefd1a4f-3f70-439c-8308-16e34d47e985", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] Acquired lock "refresh_cache-f2b08056-0591-41d9-aad4-76f759b3751f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Refreshing network info cache for port aefd1a4f-3f70-439c-8308-16e34d47e985 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Updated VIF entry in instance network info cache for port aefd1a4f-3f70-439c-8308-16e34d47e985. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Updating instance_info_cache with network_info: [{"id": "aefd1a4f-3f70-439c-8308-16e34d47e985", "address": "fa:16:3e:c6:77:b8", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefd1a4f-3f", "ovs_interfaceid": "aefd1a4f-3f70-439c-8308-16e34d47e985", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8002c072-cf49-4bf2-9b9b-29bf3d129672 req-5ece0997-2c4a-4adf-ad9a-51e7d04d2a46 service nova] Releasing lock "refresh_cache-f2b08056-0591-41d9-aad4-76f759b3751f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:38:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:38:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbBUPwqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:38:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:38:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:38:19 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c91b0e-7b1c-4aab-8c75-621526506c20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:38:19 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc05ed-7168-4cd9-9764-d2b6cb35e678]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46] added
Nov 10 22:38:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bc7a4e-5f65-4b4d-9b9b-ac44c26c539b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d6a07-22e8-4fd1-9ae7-3ef4d9017999]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbBUPwqF {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbBUPwqF" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[105b5e27-9fdb-49b8-8897-a43a057a3dd1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IbBUPwqF'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b1932-41be-45ef-b3cd-c3e819ca2a93]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[42938dc0-91a2-48a0-83f0-8048530201c6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c1ed3-f431-46ba-8be7-4149a99958e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260]
Nov 10 22:38:19 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260] successful.
Nov 10 22:38:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ada4176-75d2-4d0a-921a-559a32598c53]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3c6a22-e4c0-4566-b724-aed30428bbc9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:19 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 is timed out.
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Successfully detached device sdc from instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 from the live domain config.
Nov 10 22:38:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZtjYGbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:38:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b6000-8b8a-483b-8282-2a8a36283d1d]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:38:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbBUPwqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80788251-eb95-4022-8170-d219f083c64f is timed out.
Nov 10 22:38:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Successfully detached device vdb from instance 80788251-eb95-4022-8170-d219f083c64f from the live domain config.
Nov 10 22:38:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWYZvLqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:38:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23163646466363663', 'path': '/dev/sdi'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163646466363663', 'path': '/dev/sdi'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.052s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lazy-loading 'flavor' on Instance uuid 5e3770a5-16c7-4b7e-8826-ebd2861085b4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] attach device xml: <disk type="block" device="disk">
Nov 10 22:38:20 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:38:20 user nova-compute[75288]:   <source dev="/dev/sdi"/>
Nov 10 22:38:20 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:38:20 user nova-compute[75288]:   <serial>74df3c2d-53cb-4eee-af14-5499d8d1ff46</serial>
Nov 10 22:38:20 user nova-compute[75288]: </disk>
Nov 10 22:38:20 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02f2fae-be29-4d10-ba6b-6543385fe685]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:38:20 user nova-compute[75288]: No targets found.
Nov 10 22:38:20 user nova-compute[75288]: iSNS:
Nov 10 22:38:20 user nova-compute[75288]: No targets found.
Nov 10 22:38:20 user nova-compute[75288]: STATIC:
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46
Nov 10 22:38:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:20 user nova-compute[75288]: FIRMWARE:
Nov 10 22:38:20 user nova-compute[75288]: No targets found.
Nov 10 22:38:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:38:20 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:38:20 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[79593d1c-a2cb-4794-9619-aaa6a3c35931]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f8fc8b-465a-4a84-a187-822f5da45e67]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:20 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b107e2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:38:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2d743-eec2-4f35-8f45-536638ac6717]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d54eab-1ca4-4f78-8891-160a9160ecda]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b0d51-2305-4f1c-9789-6b8e6dc3838f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c6086b-16bb-4f73-a90c-1912d3fd212a]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e0514-6823-44f5-b4ba-a8e5a29ead70]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf587eb-5ac9-4dd5-9c80-e225977556a1]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260]
Nov 10 22:38:21 user nova-compute[75288]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a, portal: 172.16.0.220,3260] successful.
Nov 10 22:38:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50714c66-b6cb-4cfd-9302-454984cf5d7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41eaedf-fac0-4c20-b74c-f93d5deb7b68]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] <== disconnect_volume: return (1489ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.139s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62091cac-1ec7-4664-befa-67468aee68da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:38:21 user nova-compute[75288]: No targets found.
Nov 10 22:38:21 user nova-compute[75288]: iSNS:
Nov 10 22:38:21 user nova-compute[75288]: No targets found.
Nov 10 22:38:21 user nova-compute[75288]: STATIC:
Nov 10 22:38:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:38:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:21 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07
Nov 10 22:38:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:21 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:38:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:21 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d
Nov 10 22:38:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:21 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047
Nov 10 22:38:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:21 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f
Nov 10 22:38:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:21 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46
Nov 10 22:38:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:21 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:21 user nova-compute[75288]: FIRMWARE:
Nov 10 22:38:21 user nova-compute[75288]: No targets found.
Nov 10 22:38:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:38:21 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:38:21 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[232cdcac-58d4-45a4-a8e7-c843e377133c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29145ae-529b-48bd-a2a3-32729c1bbbff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:21 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b281a1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191f38c-b813-46a4-aa2d-d3f8b6266a1f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] No VIF found with MAC fa:16:3e:f8:05:f5, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948e00a-fa5b-47f3-8167-151158da41be]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3c5fad-a280-4a2a-805a-efbdb0d8190f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed79e1f2-d17f-4f49-8505-07aca8491613]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a737be-942a-47bd-8e98-15dfaf0a5e89]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6b57de9-3ac9-40c0-af69-7fe61b582a37 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 61.456s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dbd56f-cddf-4375-bbde-f56a3162aeb5]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260]
Nov 10 22:38:21 user nova-compute[75288]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047, portal: 172.16.0.220,3260] successful.
Nov 10 22:38:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac32982d-65d5-4e9b-98c3-9d43b45b6047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e74d770-9547-4e85-b432-437ce5d6a29a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.555s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] <== disconnect_volume: return (1693ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lazy-loading 'flavor' on Instance uuid 7668df42-4bbb-4913-97e7-3b4b67f94eb1 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cfe28963-1efc-464a-962b-5496755d9b77 tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.927s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.volume.cinder [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Update attachment failed for attachment ecd9c5e5-039a-47de-8521-23c9afdd7263. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-deecbed6-bd31-4833-aab5-5ac572f3f775) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-deecbed6-bd31-4833-aab5-5ac572f3f775)
Nov 10 22:38:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] volume_snapshot_create: create_info: {'snapshot_id': '87cdd9f8-af72-44ba-867d-54705ee770c1', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75288) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-deecbed6-bd31-4833-aab5-5ac572f3f775)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Traceback (most recent call last):
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     driver_block_device.attach_block_devices(
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     _log_and_attach(device)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     self._do_attach(context, instance, volume, volume_api,
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     self._volume_attach(context, volume, connector, instance,
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     connection_info = volume_api.attachment_update(
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     res = method(self, ctx, *args, **kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     with excutils.save_and_reraise_exception():
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     self.force_reraise()
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     raise self.value
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     return method.func(obj, *args, **kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     resp = self._update('/attachments/%s' % id, body)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     return self.request(url, method, **kwargs)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc]     raise exceptions.from_response(resp, body)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-deecbed6-bd31-4833-aab5-5ac572f3f775)
Nov 10 22:38:22 user nova-compute[75288]: ERROR nova.compute.manager [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] 
Nov 10 22:38:22 user nova-compute[75288]: DEBUG nova.compute.claims [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Aborting claim: <nova.compute.claims.Claim object at 0x7f4b107316f0> {{(pid=75288) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] snap xml: <domainsnapshot>
Nov 10 22:38:22 user nova-compute[75288]:   <disks>
Nov 10 22:38:22 user nova-compute[75288]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 10 22:38:22 user nova-compute[75288]:       <source file="/dev/new_file"/>
Nov 10 22:38:22 user nova-compute[75288]:     </disk>
Nov 10 22:38:22 user nova-compute[75288]:     <disk name="vda" snapshot="no"/>
Nov 10 22:38:22 user nova-compute[75288]:   </disks>
Nov 10 22:38:22 user nova-compute[75288]: </domainsnapshot>
Nov 10 22:38:22 user nova-compute[75288]:  {{(pid=75288) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] Lazy-loading 'system_metadata' on Instance uuid 5e3770a5-16c7-4b7e-8826-ebd2861085b4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lazy-loading 'flavor' on Instance uuid 80788251-eb95-4022-8170-d219f083c64f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-13929fed-e178-4442-91d9-3bb250dbcb2d tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] volume_snapshot_delete: delete_info: {'volume_id': '74df3c2d-53cb-4eee-af14-5499d8d1ff46'} {{(pid=75288) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-13929fed-e178-4442-91d9-3bb250dbcb2d tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     if delete_info['type'] != 'qcow2':
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] KeyError: 'type'
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] 
Nov 10 22:38:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     rv = execute(f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     six.reraise(c, e, tb)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     raise value
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     rv = meth(*args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     self._volume_snapshot_create(context, instance, guest,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     rv = execute(f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     six.reraise(c, e, tb)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     raise value
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     rv = meth(*args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] 
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d50ac4a7-fe3b-4e9b-8e3d-1785a4bcfe8d tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.949s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-13929fed-e178-4442-91d9-3bb250dbcb2d tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a477adf5-e89c-40d4-8c4f-03c612f7cb79)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server [None req-13929fed-e178-4442-91d9-3bb250dbcb2d tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] Exception during message handling: KeyError: 'type'
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server 
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 87cdd9f8-af72-44ba-867d-54705ee770c1 could not be found.
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise value
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 87cdd9f8-af72-44ba-867d-54705ee770c1 could not be found. (HTTP 404) (Request-ID: req-9bbbb927-3df2-4bc7-ab36-916925344f98)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 87cdd9f8-af72-44ba-867d-54705ee770c1 could not be found.
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server [None req-5814cd18-d2e3-4012-a021-21127518cb47 tempest-VolumesAssistedSnapshotsTest-1045670287 tempest-VolumesAssistedSnapshotsTest-1045670287-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise value
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 22:38:23 user nova-compute[75288]: ERROR oslo_messaging.rpc.server 
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:23 user nova-compute[75288]: INFO nova.compute.manager [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Terminating instance
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: INFO nova.compute.manager [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Detaching volume 74df3c2d-53cb-4eee-af14-5499d8d1ff46
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:23 user nova-compute[75288]: INFO nova.virt.block_device [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Attempting to driver detach volume 74df3c2d-53cb-4eee-af14-5499d8d1ff46 from mountpoint /dev/vdb
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Attempting to detach device vdb from instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 22:38:23 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:38:23 user nova-compute[75288]:   <source dev="/dev/sdi"/>
Nov 10 22:38:23 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:38:23 user nova-compute[75288]:   <serial>74df3c2d-53cb-4eee-af14-5499d8d1ff46</serial>
Nov 10 22:38:23 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:38:23 user nova-compute[75288]: </disk>
Nov 10 22:38:23 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:38:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Successfully detached device vdb from instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 from the persistent domain config.
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 22:38:23 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:38:23 user nova-compute[75288]:   <source dev="/dev/sdi"/>
Nov 10 22:38:23 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:38:23 user nova-compute[75288]:   <serial>74df3c2d-53cb-4eee-af14-5499d8d1ff46</serial>
Nov 10 22:38:23 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:38:23 user nova-compute[75288]: </disk>
Nov 10 22:38:23 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.775s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Build of instance 3986f2b4-5e46-4834-9f66-ad5f9a0873bc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-deecbed6-bd31-4833-aab5-5ac572f3f775) {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.utils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Build of instance 3986f2b4-5e46-4834-9f66-ad5f9a0873bc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75288) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 22:38:23 user nova-compute[75288]: ERROR nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Build of instance 3986f2b4-5e46-4834-9f66-ad5f9a0873bc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-deecbed6-bd31-4833-aab5-5ac572f3f775): nova.exception.BuildAbortException: Build of instance 3986f2b4-5e46-4834-9f66-ad5f9a0873bc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-deecbed6-bd31-4833-aab5-5ac572f3f775)
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Unplugging VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2080722653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2080722653',id=11,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFJWaKiXbNJalJvJCjsX4adyyYtUIjWk8OLnC+LK6HxbZlhLka+Upe6Fig0/6fyN6dU9Qmpu9XFZN/jcUIhgY0Xbyd4lNQgAqjd87FNuj/Rcm0OLaCB+NeCgoezzd1oXg==',key_name='tempest-keypair-571079658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb1369d3ab04e03a202a6a630b0fd3f',ramdisk_id='',reservation_id='r-n3kapdwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1335775053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1335775053-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbb03921b14c4738a322fe082d986aec',uuid=3986f2b4-5e46-4834-9f66-ad5f9a0873bc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "address": "fa:16:3e:eb:22:53", "network": {"id": "514b6a3c-3c91-4b6b-91f4-eca03aa8643f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1864138639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed4704e-0f", "ovs_interfaceid": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converting VIF {"id": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "address": "fa:16:3e:eb:22:53", "network": {"id": "514b6a3c-3c91-4b6b-91f4-eca03aa8643f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1864138639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaed4704e-0f", "ovs_interfaceid": "aed4704e-0fe6-4636-92fc-2e3d4b13b7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:22:53,bridge_name='br-int',has_traffic_filtering=True,id=aed4704e-0fe6-4636-92fc-2e3d4b13b7e9,network=Network(514b6a3c-3c91-4b6b-91f4-eca03aa8643f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed4704e-0f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:22:53,bridge_name='br-int',has_traffic_filtering=True,id=aed4704e-0fe6-4636-92fc-2e3d4b13b7e9,network=Network(514b6a3c-3c91-4b6b-91f4-eca03aa8643f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed4704e-0f') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaed4704e-0f, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:23 user nova-compute[75288]: INFO os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:22:53,bridge_name='br-int',has_traffic_filtering=True,id=aed4704e-0fe6-4636-92fc-2e3d4b13b7e9,network=Network(514b6a3c-3c91-4b6b-91f4-eca03aa8643f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaed4704e-0f')
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2080722653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2080722653',id=11,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFJWaKiXbNJalJvJCjsX4adyyYtUIjWk8OLnC+LK6HxbZlhLka+Upe6Fig0/6fyN6dU9Qmpu9XFZN/jcUIhgY0Xbyd4lNQgAqjd87FNuj/Rcm0OLaCB+NeCgoezzd1oXg==',key_name='tempest-keypair-571079658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb1369d3ab04e03a202a6a630b0fd3f',ramdisk_id='',reservation_id='r-n3kapdwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1335775053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1335775053-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbb03921b14c4738a322fe082d986aec',uuid=3986f2b4-5e46-4834-9f66-ad5f9a0873bc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "address": "fa:16:3e:b2:b6:6e", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3a14a7-5e", "ovs_interfaceid": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converting VIF {"id": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "address": "fa:16:3e:b2:b6:6e", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e3a14a7-5e", "ovs_interfaceid": "2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b6:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2e3a14a7-5e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b6:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2e3a14a7-5e') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e3a14a7-5e, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:23 user nova-compute[75288]: INFO os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:b6:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e3a14a7-5e7a-4ac4-9e7a-5ceea3dfd204,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2e3a14a7-5e')
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2080722653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2080722653',id=11,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFJWaKiXbNJalJvJCjsX4adyyYtUIjWk8OLnC+LK6HxbZlhLka+Upe6Fig0/6fyN6dU9Qmpu9XFZN/jcUIhgY0Xbyd4lNQgAqjd87FNuj/Rcm0OLaCB+NeCgoezzd1oXg==',key_name='tempest-keypair-571079658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb1369d3ab04e03a202a6a630b0fd3f',ramdisk_id='',reservation_id='r-n3kapdwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1335775053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1335775053-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbb03921b14c4738a322fe082d986aec',uuid=3986f2b4-5e46-4834-9f66-ad5f9a0873bc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10deb149-79ae-409d-b69d-3d9b74662b72", "address": "fa:16:3e:b1:4e:52", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10deb149-79", "ovs_interfaceid": "10deb149-79ae-409d-b69d-3d9b74662b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converting VIF {"id": "10deb149-79ae-409d-b69d-3d9b74662b72", "address": "fa:16:3e:b1:4e:52", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10deb149-79", "ovs_interfaceid": "10deb149-79ae-409d-b69d-3d9b74662b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=10deb149-79ae-409d-b69d-3d9b74662b72,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10deb149-79') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=10deb149-79ae-409d-b69d-3d9b74662b72,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10deb149-79') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10deb149-79, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:23 user nova-compute[75288]: INFO os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4e:52,bridge_name='br-int',has_traffic_filtering=True,id=10deb149-79ae-409d-b69d-3d9b74662b72,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap10deb149-79')
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2080722653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2080722653',id=11,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFJWaKiXbNJalJvJCjsX4adyyYtUIjWk8OLnC+LK6HxbZlhLka+Upe6Fig0/6fyN6dU9Qmpu9XFZN/jcUIhgY0Xbyd4lNQgAqjd87FNuj/Rcm0OLaCB+NeCgoezzd1oXg==',key_name='tempest-keypair-571079658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb1369d3ab04e03a202a6a630b0fd3f',ramdisk_id='',reservation_id='r-n3kapdwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1335775053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1335775053-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbb03921b14c4738a322fe082d986aec',uuid=3986f2b4-5e46-4834-9f66-ad5f9a0873bc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "address": "fa:16:3e:03:18:4c", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47bcd3bf-0f", "ovs_interfaceid": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converting VIF {"id": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "address": "fa:16:3e:03:18:4c", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47bcd3bf-0f", "ovs_interfaceid": "47bcd3bf-0fb2-4335-b6ca-afe1b8a61031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:4c,bridge_name='br-int',has_traffic_filtering=True,id=47bcd3bf-0fb2-4335-b6ca-afe1b8a61031,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47bcd3bf-0f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:4c,bridge_name='br-int',has_traffic_filtering=True,id=47bcd3bf-0fb2-4335-b6ca-afe1b8a61031,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47bcd3bf-0f') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47bcd3bf-0f, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:23 user nova-compute[75288]: INFO os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:4c,bridge_name='br-int',has_traffic_filtering=True,id=47bcd3bf-0fb2-4335-b6ca-afe1b8a61031,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47bcd3bf-0f')
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2080722653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2080722653',id=11,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFJWaKiXbNJalJvJCjsX4adyyYtUIjWk8OLnC+LK6HxbZlhLka+Upe6Fig0/6fyN6dU9Qmpu9XFZN/jcUIhgY0Xbyd4lNQgAqjd87FNuj/Rcm0OLaCB+NeCgoezzd1oXg==',key_name='tempest-keypair-571079658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb1369d3ab04e03a202a6a630b0fd3f',ramdisk_id='',reservation_id='r-n3kapdwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1335775053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1335775053-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbb03921b14c4738a322fe082d986aec',uuid=3986f2b4-5e46-4834-9f66-ad5f9a0873bc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "address": "fa:16:3e:6d:99:f0", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5b9e0c-54", "ovs_interfaceid": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converting VIF {"id": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "address": "fa:16:3e:6d:99:f0", "network": {"id": "08e5bcdf-e1d6-4ac4-8bde-d3020337708b", "bridge": "br-int", "label": "tempest-device-tagging-net1-535424351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5b9e0c-54", "ovs_interfaceid": "7d5b9e0c-5479-40ab-a777-5aa92d724f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=7d5b9e0c-5479-40ab-a777-5aa92d724f3e,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5b9e0c-54') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=7d5b9e0c-5479-40ab-a777-5aa92d724f3e,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5b9e0c-54') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d5b9e0c-54, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:23 user nova-compute[75288]: INFO os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=7d5b9e0c-5479-40ab-a777-5aa92d724f3e,network=Network(08e5bcdf-e1d6-4ac4-8bde-d3020337708b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5b9e0c-54')
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2080722653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2080722653',id=11,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFJWaKiXbNJalJvJCjsX4adyyYtUIjWk8OLnC+LK6HxbZlhLka+Upe6Fig0/6fyN6dU9Qmpu9XFZN/jcUIhgY0Xbyd4lNQgAqjd87FNuj/Rcm0OLaCB+NeCgoezzd1oXg==',key_name='tempest-keypair-571079658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb1369d3ab04e03a202a6a630b0fd3f',ramdisk_id='',reservation_id='r-n3kapdwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1335775053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1335775053-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbb03921b14c4738a322fe082d986aec',uuid=3986f2b4-5e46-4834-9f66-ad5f9a0873bc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "address": "fa:16:3e:e7:1e:fd", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391aa5f6-f1", "ovs_interfaceid": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converting VIF {"id": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "address": "fa:16:3e:e7:1e:fd", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391aa5f6-f1", "ovs_interfaceid": "391aa5f6-f153-4ca1-af05-a0a208bf7e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1e:fd,bridge_name='br-int',has_traffic_filtering=True,id=391aa5f6-f153-4ca1-af05-a0a208bf7e09,network=Network(34cc0e7a-74a3-4445-9cf1-b875b881ab8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391aa5f6-f1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1e:fd,bridge_name='br-int',has_traffic_filtering=True,id=391aa5f6-f153-4ca1-af05-a0a208bf7e09,network=Network(34cc0e7a-74a3-4445-9cf1-b875b881ab8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391aa5f6-f1') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391aa5f6-f1, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-7bdd5d3d-cf19-405e-baab-a37d6eea5bd1 req-49aec80f-b479-43d1-999f-d85be8bb6be9 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-vif-unplugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7bdd5d3d-cf19-405e-baab-a37d6eea5bd1 req-49aec80f-b479-43d1-999f-d85be8bb6be9 service nova] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7bdd5d3d-cf19-405e-baab-a37d6eea5bd1 req-49aec80f-b479-43d1-999f-d85be8bb6be9 service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7bdd5d3d-cf19-405e-baab-a37d6eea5bd1 req-49aec80f-b479-43d1-999f-d85be8bb6be9 service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-7bdd5d3d-cf19-405e-baab-a37d6eea5bd1 req-49aec80f-b479-43d1-999f-d85be8bb6be9 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] No waiting events found dispatching network-vif-unplugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-7bdd5d3d-cf19-405e-baab-a37d6eea5bd1 req-49aec80f-b479-43d1-999f-d85be8bb6be9 service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-vif-unplugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:38:23 user nova-compute[75288]: INFO os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1e:fd,bridge_name='br-int',has_traffic_filtering=True,id=391aa5f6-f153-4ca1-af05-a0a208bf7e09,network=Network(34cc0e7a-74a3-4445-9cf1-b875b881ab8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391aa5f6-f1')
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2080722653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2080722653',id=11,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFJWaKiXbNJalJvJCjsX4adyyYtUIjWk8OLnC+LK6HxbZlhLka+Upe6Fig0/6fyN6dU9Qmpu9XFZN/jcUIhgY0Xbyd4lNQgAqjd87FNuj/Rcm0OLaCB+NeCgoezzd1oXg==',key_name='tempest-keypair-571079658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb1369d3ab04e03a202a6a630b0fd3f',ramdisk_id='',reservation_id='r-n3kapdwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1335775053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1335775053-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbb03921b14c4738a322fe082d986aec',uuid=3986f2b4-5e46-4834-9f66-ad5f9a0873bc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "address": "fa:16:3e:67:0e:4f", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50768b8a-11", "ovs_interfaceid": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converting VIF {"id": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "address": "fa:16:3e:67:0e:4f", "network": {"id": "34cc0e7a-74a3-4445-9cf1-b875b881ab8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1176385913", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bb1369d3ab04e03a202a6a630b0fd3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50768b8a-11", "ovs_interfaceid": "50768b8a-1174-4e18-bce6-764ec39a7d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:0e:4f,bridge_name='br-int',has_traffic_filtering=True,id=50768b8a-1174-4e18-bce6-764ec39a7d6b,network=Network(34cc0e7a-74a3-4445-9cf1-b875b881ab8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50768b8a-11') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:0e:4f,bridge_name='br-int',has_traffic_filtering=True,id=50768b8a-1174-4e18-bce6-764ec39a7d6b,network=Network(34cc0e7a-74a3-4445-9cf1-b875b881ab8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50768b8a-11') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50768b8a-11, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:23 user nova-compute[75288]: INFO os_vif [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:0e:4f,bridge_name='br-int',has_traffic_filtering=True,id=50768b8a-1174-4e18-bce6-764ec39a7d6b,network=Network(34cc0e7a-74a3-4445-9cf1-b875b881ab8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50768b8a-11')
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Unplugged VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:38:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:38:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Instance destroyed successfully.
Nov 10 22:38:24 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lazy-loading 'resources' on Instance uuid 7668df42-4bbb-4913-97e7-3b4b67f94eb1 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:24 user nova-compute[75288]: INFO nova.compute.manager [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Unshelving
Nov 10 22:38:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:38:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:38:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=25.482589721679688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-191786997',display_name='tempest-AttachSCSIVolumeTestJSON-server-191786997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-191786997',id=6,image_ref='8918b081-30d4-479f-9cc7-c2e6b4411e30',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmtrlRmmb8ffCSyXbIY8mxc1bqvWnSI7BoXiP10OGMDVb4AVqpQq3tTbaJKeTrN3JLnLegeM5PK8x74DkR0B67t7vKXIOgAa7SH7YgZCD/WhedNjuaew5xJfLKK5KXwvA==',key_name='tempest-keypair-2086273440',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c49a6f48188d42f395db22e590f1f17b',ramdisk_id='',reservation_id='r-5y6p04fx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8918b081-30d4-479f-9cc7-c2e6b4411e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-795028462',owner_user_name='tempest-AttachSCSIVolumeTestJSON-795028462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ef514f184d416192ea5c6ce23e476f',uuid=7668df42-4bbb-4913-97e7-3b4b67f94eb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Converting VIF {"id": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "address": "fa:16:3e:cd:70:e2", "network": {"id": "d4bcd532-53bb-42e7-a2b6-f76841b40ba9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1619903714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49a6f48188d42f395db22e590f1f17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3b08c2-56", "ovs_interfaceid": "1b3b08c2-56ad-41fe-b4f9-80f63d87641f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:70:e2,bridge_name='br-int',has_traffic_filtering=True,id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f,network=Network(d4bcd532-53bb-42e7-a2b6-f76841b40ba9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3b08c2-56') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG os_vif [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:70:e2,bridge_name='br-int',has_traffic_filtering=True,id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f,network=Network(d4bcd532-53bb-42e7-a2b6-f76841b40ba9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3b08c2-56') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3b08c2-56, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bf0b93c-7fc3-4689-b7da-ff554d7f5755) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:38:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:24 user nova-compute[75288]: INFO os_vif [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:70:e2,bridge_name='br-int',has_traffic_filtering=True,id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f,network=Network(d4bcd532-53bb-42e7-a2b6-f76841b40ba9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b3b08c2-56')
Nov 10 22:38:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Deleting instance files /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1_del
Nov 10 22:38:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Deletion of /opt/stack/data/nova/instances/7668df42-4bbb-4913-97e7-3b4b67f94eb1_del complete
Nov 10 22:38:25 user nova-compute[75288]: INFO nova.virt.block_device [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Booting with volume 81e85fec-9286-49b5-81a2-ff2bdc4fe547 at /dev/vdc
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 80788251-eb95-4022-8170-d219f083c64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d5b1e547-fd1e-432b-a921-59f3c4702c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7e41f40b-859f-4239-b5e5-a787af7e28ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: INFO nova.compute.manager [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 3986f2b4-5e46-4834-9f66-ad5f9a0873bc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f2b08056-0591-41d9-aad4-76f759b3751f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.utils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03c283a-e759-41d7-bf11-e364e70d9e40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 is timed out.
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e7bab0-c78f-4d9d-a767-5532199fa531]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully detached device vdb from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the live domain config.
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vZFfLSDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:38:25 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e66d28-5f8a-4de9-8579-4a485abcbf71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb9a62-048c-44eb-b76f-86a8afbc70ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5938a26c-0e01-4291-a0ae-1bf4ae53fd81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:38:25 user nova-compute[75288]: No targets found.
Nov 10 22:38:25 user nova-compute[75288]: iSNS:
Nov 10 22:38:25 user nova-compute[75288]: No targets found.
Nov 10 22:38:25 user nova-compute[75288]: STATIC:
Nov 10 22:38:25 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:38:25 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:25 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:25 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07
Nov 10 22:38:25 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:25 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:25 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:38:25 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:25 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:25 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d
Nov 10 22:38:25 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:25 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:25 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f
Nov 10 22:38:25 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:25 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:25 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46
Nov 10 22:38:25 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:25 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:25 user nova-compute[75288]: FIRMWARE:
Nov 10 22:38:25 user nova-compute[75288]: No targets found.
Nov 10 22:38:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:38:25 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:38:25 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:38:25 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48b12f3-a50f-43f7-b10e-c70b7c56a8ce]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.utils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating existing volume attachment record: 4adb1a5f-4361-4605-88c8-44e4c926877e {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da6cb5-6da9-4123-aed5-7115243227fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696e47f-0b50-4b1c-83fa-daedd0474225]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:25 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f (non-flash)
Nov 10 22:38:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b103272e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f'): ({'sdh'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Removing single pathed devices sdh {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3f1527-c5df-4d7c-88b2-ef3aa7079644]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[532d3f6c-8ecb-4cb4-8556-23cd219f51a4]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Flushing IO for device /dev/sdh {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76efdec-8851-4f76-9058-ea514c97c7bd]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d1d67-5e2f-429b-9444-04287eea2111]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] SCSI volumes sdh have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.095s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[36440249-b201-4d5f-8a50-433cfdf08ba7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a457fb49-eced-4a0c-bbed-757ca33de2a2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260]
Nov 10 22:38:25 user nova-compute[75288]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f, portal: 172.16.0.220,3260] successful.
Nov 10 22:38:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b691374a-5624-47e7-b87c-d3f890a39c6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdda0d5b-afcf-41e3-90a2-e9909cf49651]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.569s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] <== disconnect_volume: return (571ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.935s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-38ae7213-c117-45c3-be27-faad9d96e5e2 req-712e7d05-b5bd-4b2a-94be-01924e0dd8db service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38ae7213-c117-45c3-be27-faad9d96e5e2 req-712e7d05-b5bd-4b2a-94be-01924e0dd8db service nova] Acquiring lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38ae7213-c117-45c3-be27-faad9d96e5e2 req-712e7d05-b5bd-4b2a-94be-01924e0dd8db service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38ae7213-c117-45c3-be27-faad9d96e5e2 req-712e7d05-b5bd-4b2a-94be-01924e0dd8db service nova] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-38ae7213-c117-45c3-be27-faad9d96e5e2 req-712e7d05-b5bd-4b2a-94be-01924e0dd8db service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] No waiting events found dispatching network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:25 user nova-compute[75288]: WARNING nova.compute.manager [req-38ae7213-c117-45c3-be27-faad9d96e5e2 req-712e7d05-b5bd-4b2a-94be-01924e0dd8db service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received unexpected event network-vif-plugged-1b3b08c2-56ad-41fe-b4f9-80f63d87641f for instance with vm_state active and task_state deleting.
Nov 10 22:38:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d66cbe-6721-4c47-b8d6-8b5fe66a70b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889ff71-e0f8-485c-a6e9-f033e6d87772]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae68739-454c-4f46-bb84-c62cf6ecea9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec8af62-8ccd-49fe-8584-7e25d33ad9ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:38:26 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8fd6ec-8b60-4f56-b603-97c04e59bd3a]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Updating existing volume attachment record: 74141137-0dca-4ab5-8cfc-858dc9f31ef1 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-39355bba-0513-466c-83d6-73522e1db4cc req-08fed7da-0443-4286-aa87-473f0f6225ca service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Received event network-vif-deleted-1b3b08c2-56ad-41fe-b4f9-80f63d87641f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:26 user nova-compute[75288]: INFO nova.compute.manager [req-39355bba-0513-466c-83d6-73522e1db4cc req-08fed7da-0443-4286-aa87-473f0f6225ca service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Neutron deleted interface 1b3b08c2-56ad-41fe-b4f9-80f63d87641f; detaching it from the instance and deleting it from the info cache
Nov 10 22:38:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-39355bba-0513-466c-83d6-73522e1db4cc req-08fed7da-0443-4286-aa87-473f0f6225ca service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:26 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Took 1.38 seconds to deallocate network for instance.
Nov 10 22:38:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-39355bba-0513-466c-83d6-73522e1db4cc req-08fed7da-0443-4286-aa87-473f0f6225ca service nova] [instance: 7668df42-4bbb-4913-97e7-3b4b67f94eb1] Detach interface failed, port_id=1b3b08c2-56ad-41fe-b4f9-80f63d87641f, reason: Instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:38:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'flavor' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0f22080a-cb79-4932-83f2-c1ed325a22ce tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.101s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "interface-d5b1e547-fd1e-432b-a921-59f3c4702c47-52e65878-df33-444f-a67c-3957c36b598c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "interface-d5b1e547-fd1e-432b-a921-59f3c4702c47-52e65878-df33-444f-a67c-3957c36b598c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'flavor' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.649s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converting VIF {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Attempting to detach device tap52e65878-df from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] detach device xml: <interface type="ethernet">
Nov 10 22:38:27 user nova-compute[75288]:   <mac address="fa:16:3e:5f:37:a5"/>
Nov 10 22:38:27 user nova-compute[75288]:   <model type="virtio"/>
Nov 10 22:38:27 user nova-compute[75288]:   <mtu size="1442"/>
Nov 10 22:38:27 user nova-compute[75288]:   <target dev="tap52e65878-df"/>
Nov 10 22:38:27 user nova-compute[75288]: </interface>
Nov 10 22:38:27 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 10 22:38:27 user nova-compute[75288]:   <name>instance-00000008</name>
Nov 10 22:38:27 user nova-compute[75288]:   <uuid>d5b1e547-fd1e-432b-a921-59f3c4702c47</uuid>
Nov 10 22:38:27 user nova-compute[75288]:   <metadata>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:38:27 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Nov 10 22:38:27 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:38:27 user nova-compute[75288]:   <nova:creationTime>2023-11-10 22:37:02</nova:creationTime>
Nov 10 22:38:27 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Nov 10 22:38:27 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Nov 10 22:38:27 user nova-compute[75288]:   </nova:flavor>
Nov 10 22:38:27 user nova-compute[75288]:   <nova:owner>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:38:27 user nova-compute[75288]:   </nova:owner>
Nov 10 22:38:27 user nova-compute[75288]:   <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:38:27 user nova-compute[75288]:   <nova:ports>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:38:27 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:38:27 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:27 user nova-compute[75288]:     <nova:port uuid="52e65878-df33-444f-a67c-3957c36b598c">
Nov 10 22:38:27 user nova-compute[75288]:       <nova:ip type="fixed" address="10.10.10.31" ipVersion="4"/>
Nov 10 22:38:27 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:27 user nova-compute[75288]:   </nova:ports>
Nov 10 22:38:27 user nova-compute[75288]: </nova:instance>
Nov 10 22:38:27 user nova-compute[75288]:   </metadata>
Nov 10 22:38:27 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Nov 10 22:38:27 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 22:38:27 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Nov 10 22:38:27 user nova-compute[75288]:   <resource>
Nov 10 22:38:27 user nova-compute[75288]:     <partition>/machine</partition>
Nov 10 22:38:27 user nova-compute[75288]:   </resource>
Nov 10 22:38:27 user nova-compute[75288]:   <sysinfo type='smbios'>
Nov 10 22:38:27 user nova-compute[75288]:     <system>
Nov 10 22:38:27 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 22:38:27 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 22:38:27 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Nov 10 22:38:27 user nova-compute[75288]:       <entry name='serial'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:27 user nova-compute[75288]:       <entry name='uuid'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:27 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Nov 10 22:38:27 user nova-compute[75288]:     </system>
Nov 10 22:38:27 user nova-compute[75288]:   </sysinfo>
Nov 10 22:38:27 user nova-compute[75288]:   <os>
Nov 10 22:38:27 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 22:38:27 user nova-compute[75288]:     <boot dev='hd'/>
Nov 10 22:38:27 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Nov 10 22:38:27 user nova-compute[75288]:   </os>
Nov 10 22:38:27 user nova-compute[75288]:   <features>
Nov 10 22:38:27 user nova-compute[75288]:     <acpi/>
Nov 10 22:38:27 user nova-compute[75288]:     <apic/>
Nov 10 22:38:27 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Nov 10 22:38:27 user nova-compute[75288]:   </features>
Nov 10 22:38:27 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 22:38:27 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Nov 10 22:38:27 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 22:38:27 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Nov 10 22:38:27 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Nov 10 22:38:27 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Nov 10 22:38:27 user nova-compute[75288]:   </cpu>
Nov 10 22:38:27 user nova-compute[75288]:   <clock offset='utc'>
Nov 10 22:38:27 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 22:38:27 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 22:38:27 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Nov 10 22:38:27 user nova-compute[75288]:   </clock>
Nov 10 22:38:27 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Nov 10 22:38:27 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Nov 10 22:38:27 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Nov 10 22:38:27 user nova-compute[75288]:   <devices>
Nov 10 22:38:27 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 22:38:27 user nova-compute[75288]:     <disk type='file' device='disk'>
Nov 10 22:38:27 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 22:38:27 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk' index='2'/>
Nov 10 22:38:27 user nova-compute[75288]:       <backingStore type='file' index='3'>
Nov 10 22:38:27 user nova-compute[75288]:         <format type='raw'/>
Nov 10 22:38:27 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec'/>
Nov 10 22:38:27 user nova-compute[75288]:         <backingStore/>
Nov 10 22:38:27 user nova-compute[75288]:       </backingStore>
Nov 10 22:38:27 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </disk>
Nov 10 22:38:27 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Nov 10 22:38:27 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 22:38:27 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config' index='1'/>
Nov 10 22:38:27 user nova-compute[75288]:       <backingStore/>
Nov 10 22:38:27 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Nov 10 22:38:27 user nova-compute[75288]:       <readonly/>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </disk>
Nov 10 22:38:27 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='usb'/>
Nov 10 22:38:27 user nova-compute[75288]:     </controller>
Nov 10 22:38:27 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='pci.0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </controller>
Nov 10 22:38:27 user nova-compute[75288]:     <controller type='ide' index='0'>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='ide'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 22:38:27 user nova-compute[75288]:     </controller>
Nov 10 22:38:27 user nova-compute[75288]:     <interface type='ethernet'>
Nov 10 22:38:27 user nova-compute[75288]:       <mac address='fa:16:3e:2c:d0:b2'/>
Nov 10 22:38:27 user nova-compute[75288]:       <target dev='tap9a1df759-b6'/>
Nov 10 22:38:27 user nova-compute[75288]:       <model type='virtio'/>
Nov 10 22:38:27 user nova-compute[75288]:       <mtu size='1442'/>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='net0'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </interface>
Nov 10 22:38:27 user nova-compute[75288]:     <interface type='ethernet'>
Nov 10 22:38:27 user nova-compute[75288]:       <mac address='fa:16:3e:5f:37:a5'/>
Nov 10 22:38:27 user nova-compute[75288]:       <target dev='tap52e65878-df'/>
Nov 10 22:38:27 user nova-compute[75288]:       <model type='virtio'/>
Nov 10 22:38:27 user nova-compute[75288]:       <mtu size='1442'/>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='net1'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </interface>
Nov 10 22:38:27 user nova-compute[75288]:     <serial type='pty'>
Nov 10 22:38:27 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:27 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:27 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Nov 10 22:38:27 user nova-compute[75288]:         <model name='isa-serial'/>
Nov 10 22:38:27 user nova-compute[75288]:       </target>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </serial>
Nov 10 22:38:27 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 22:38:27 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:27 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:27 user nova-compute[75288]:       <target type='serial' port='0'/>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </console>
Nov 10 22:38:27 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='input0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </input>
Nov 10 22:38:27 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='input1'/>
Nov 10 22:38:27 user nova-compute[75288]:     </input>
Nov 10 22:38:27 user nova-compute[75288]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 22:38:27 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </graphics>
Nov 10 22:38:27 user nova-compute[75288]:     <audio id='1' type='none'/>
Nov 10 22:38:27 user nova-compute[75288]:     <video>
Nov 10 22:38:27 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='video0'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </video>
Nov 10 22:38:27 user nova-compute[75288]:     <memballoon model='virtio'>
Nov 10 22:38:27 user nova-compute[75288]:       <stats period='10'/>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='balloon0'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </memballoon>
Nov 10 22:38:27 user nova-compute[75288]:     <rng model='virtio'>
Nov 10 22:38:27 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Nov 10 22:38:27 user nova-compute[75288]:       <alias name='rng0'/>
Nov 10 22:38:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 22:38:27 user nova-compute[75288]:     </rng>
Nov 10 22:38:27 user nova-compute[75288]:   </devices>
Nov 10 22:38:27 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 22:38:27 user nova-compute[75288]:     <label>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</label>
Nov 10 22:38:27 user nova-compute[75288]:     <imagelabel>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</imagelabel>
Nov 10 22:38:27 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:27 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 22:38:27 user nova-compute[75288]:     <label>+64055:+108</label>
Nov 10 22:38:27 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 22:38:27 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:27 user nova-compute[75288]: </domain>
Nov 10 22:38:27 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 22:38:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully detached device tap52e65878-df from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the persistent domain config.
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] (1/8): Attempting to detach device tap52e65878-df with device alias net1 from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] detach device xml: <interface type="ethernet">
Nov 10 22:38:27 user nova-compute[75288]:   <mac address="fa:16:3e:5f:37:a5"/>
Nov 10 22:38:27 user nova-compute[75288]:   <model type="virtio"/>
Nov 10 22:38:27 user nova-compute[75288]:   <mtu size="1442"/>
Nov 10 22:38:27 user nova-compute[75288]:   <target dev="tap52e65878-df"/>
Nov 10 22:38:27 user nova-compute[75288]: </interface>
Nov 10 22:38:27 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:38:27 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Deleted allocations for instance 7668df42-4bbb-4913-97e7-3b4b67f94eb1
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e4eb278-cf01-4bf3-864b-af06d96734ac tempest-AttachSCSIVolumeTestJSON-795028462 tempest-AttachSCSIVolumeTestJSON-795028462-project-member] Lock "7668df42-4bbb-4913-97e7-3b4b67f94eb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.367s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Start waiting for the detach event from libvirt for device tap52e65878-df with device alias net1 for instance d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-c9ba884a-55de-49e9-9334-0fb36cd6ec96 req-f89ac2f9-7ec6-4f2f-9d0e-918d4c92c69c service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-unplugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9ba884a-55de-49e9-9334-0fb36cd6ec96 req-f89ac2f9-7ec6-4f2f-9d0e-918d4c92c69c service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9ba884a-55de-49e9-9334-0fb36cd6ec96 req-f89ac2f9-7ec6-4f2f-9d0e-918d4c92c69c service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9ba884a-55de-49e9-9334-0fb36cd6ec96 req-f89ac2f9-7ec6-4f2f-9d0e-918d4c92c69c service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-c9ba884a-55de-49e9-9334-0fb36cd6ec96 req-f89ac2f9-7ec6-4f2f-9d0e-918d4c92c69c service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-unplugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:27 user nova-compute[75288]: WARNING nova.compute.manager [req-c9ba884a-55de-49e9-9334-0fb36cd6ec96 req-f89ac2f9-7ec6-4f2f-9d0e-918d4c92c69c service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received unexpected event network-vif-unplugged-52e65878-df33-444f-a67c-3957c36b598c for instance with vm_state active and task_state None.
Nov 10 22:38:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:28 user nova-compute[75288]: INFO nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Took 4.71 seconds to deallocate network for instance.
Nov 10 22:38:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Detaching volume: 7f58e6c8-e2d3-4855-94a1-20def0bce957 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 22:38:28 user nova-compute[75288]: INFO nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Detaching volume 7f58e6c8-e2d3-4855-94a1-20def0bce957
Nov 10 22:38:28 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Skipping driver_detach during remote rebuild. {{(pid=75288) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 22:38:29 user nova-compute[75288]: WARNING nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Failed to detach volume: 7f58e6c8-e2d3-4855-94a1-20def0bce957 due to 'NoneType' object has no attribute 'devices'
Nov 10 22:38:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Detaching volume: f87f616f-ee94-412d-9cc5-eb6f2f8cbe98 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 22:38:29 user nova-compute[75288]: INFO nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Detaching volume f87f616f-ee94-412d-9cc5-eb6f2f8cbe98
Nov 10 22:38:29 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Skipping driver_detach during remote rebuild. {{(pid=75288) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 22:38:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-21368ca8-ab27-4849-94ea-329b488405c1 req-db610e25-6a48-4371-8178-498d82305f0d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-21368ca8-ab27-4849-94ea-329b488405c1 req-db610e25-6a48-4371-8178-498d82305f0d service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-21368ca8-ab27-4849-94ea-329b488405c1 req-db610e25-6a48-4371-8178-498d82305f0d service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-21368ca8-ab27-4849-94ea-329b488405c1 req-db610e25-6a48-4371-8178-498d82305f0d service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-21368ca8-ab27-4849-94ea-329b488405c1 req-db610e25-6a48-4371-8178-498d82305f0d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:30 user nova-compute[75288]: WARNING nova.compute.manager [req-21368ca8-ab27-4849-94ea-329b488405c1 req-db610e25-6a48-4371-8178-498d82305f0d service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received unexpected event network-vif-plugged-52e65878-df33-444f-a67c-3957c36b598c for instance with vm_state active and task_state None.
Nov 10 22:38:30 user nova-compute[75288]: WARNING nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Failed to detach volume: f87f616f-ee94-412d-9cc5-eb6f2f8cbe98 due to 'NoneType' object has no attribute 'devices'
Nov 10 22:38:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Detaching volume: 769bf193-1f9d-4642-8dd8-119b10b28c51 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 22:38:30 user nova-compute[75288]: INFO nova.compute.manager [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Detaching volume 769bf193-1f9d-4642-8dd8-119b10b28c51
Nov 10 22:38:30 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] [instance: 3986f2b4-5e46-4834-9f66-ad5f9a0873bc] Skipping driver_detach during remote rebuild. {{(pid=75288) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 22:38:30 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Deleted allocations for instance 3986f2b4-5e46-4834-9f66-ad5f9a0873bc
Nov 10 22:38:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-764c2d07-536d-43f7-a5c9-cdd123f908ed tempest-TaggedBootDevicesTest_v242-1335775053 tempest-TaggedBootDevicesTest_v242-1335775053-project-member] Lock "3986f2b4-5e46-4834-9f66-ad5f9a0873bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 91.653s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 is timed out.
Nov 10 22:38:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Successfully detached device vdb from instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 from the live domain config.
Nov 10 22:38:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbBUPwqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:38:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6665872-2d58-49af-8b4d-b4a65a62fe8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:38:44 user nova-compute[75288]: No targets found.
Nov 10 22:38:44 user nova-compute[75288]: iSNS:
Nov 10 22:38:44 user nova-compute[75288]: No targets found.
Nov 10 22:38:44 user nova-compute[75288]: STATIC:
Nov 10 22:38:44 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:38:44 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:44 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:44 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07
Nov 10 22:38:44 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:44 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:44 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:38:44 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:44 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:44 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d
Nov 10 22:38:44 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:44 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:44 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46
Nov 10 22:38:44 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:38:44 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:38:44 user nova-compute[75288]: FIRMWARE:
Nov 10 22:38:44 user nova-compute[75288]: No targets found.
Nov 10 22:38:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:38:44 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:38:44 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae05c7dc-d648-4eaa-bd59-630e40329f47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5132cdab-eb5b-4689-a6d6-9599137e3545]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:38:44 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:38:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10327c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46'): ({'sdi'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Removing single pathed devices sdi {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3da90d-eb48-4153-8833-330f9d64eb4f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feff152-1033-412a-af7a-55c3b21a6d87]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Flushing IO for device /dev/sdi {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[486da9ce-acbf-48ed-8314-941645e1410d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b4edb-6c57-4833-b602-ffa8fe0c6a63]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] SCSI volumes sdi have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[de99117d-e692-4f69-981c-a47296c07ddb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2febe4b4-1dcc-4fc2-98c6-5a73066ef680]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260]
Nov 10 22:38:45 user nova-compute[75288]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46, portal: 172.16.0.220,3260] successful.
Nov 10 22:38:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74df3c2d-53cb-4eee-af14-5499d8d1ff46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa48a9e-40d7-4064-8ca1-942487495487]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] <== disconnect_volume: return (363ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:38:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:38:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lazy-loading 'flavor' on Instance uuid 5e3770a5-16c7-4b7e-8826-ebd2861085b4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-550b66c4-af40-4772-aab1-05bd15517a42 tempest-VolumesAssistedSnapshotsTest-131256795 tempest-VolumesAssistedSnapshotsTest-131256795-project-admin] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.888s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Waiting for libvirt event about the detach of device tap52e65878-df with device alias net1 from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 is timed out.
Nov 10 22:38:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 10 22:38:47 user nova-compute[75288]:   <name>instance-00000008</name>
Nov 10 22:38:47 user nova-compute[75288]:   <uuid>d5b1e547-fd1e-432b-a921-59f3c4702c47</uuid>
Nov 10 22:38:47 user nova-compute[75288]:   <metadata>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:38:47 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:creationTime>2023-11-10 22:37:02</nova:creationTime>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Nov 10 22:38:47 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Nov 10 22:38:47 user nova-compute[75288]:   </nova:flavor>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:owner>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:38:47 user nova-compute[75288]:   </nova:owner>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:ports>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:38:47 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:38:47 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:port uuid="52e65878-df33-444f-a67c-3957c36b598c">
Nov 10 22:38:47 user nova-compute[75288]:       <nova:ip type="fixed" address="10.10.10.31" ipVersion="4"/>
Nov 10 22:38:47 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:47 user nova-compute[75288]:   </nova:ports>
Nov 10 22:38:47 user nova-compute[75288]: </nova:instance>
Nov 10 22:38:47 user nova-compute[75288]:   </metadata>
Nov 10 22:38:47 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Nov 10 22:38:47 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 22:38:47 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Nov 10 22:38:47 user nova-compute[75288]:   <resource>
Nov 10 22:38:47 user nova-compute[75288]:     <partition>/machine</partition>
Nov 10 22:38:47 user nova-compute[75288]:   </resource>
Nov 10 22:38:47 user nova-compute[75288]:   <sysinfo type='smbios'>
Nov 10 22:38:47 user nova-compute[75288]:     <system>
Nov 10 22:38:47 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 22:38:47 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 22:38:47 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Nov 10 22:38:47 user nova-compute[75288]:       <entry name='serial'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:47 user nova-compute[75288]:       <entry name='uuid'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:47 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Nov 10 22:38:47 user nova-compute[75288]:     </system>
Nov 10 22:38:47 user nova-compute[75288]:   </sysinfo>
Nov 10 22:38:47 user nova-compute[75288]:   <os>
Nov 10 22:38:47 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 22:38:47 user nova-compute[75288]:     <boot dev='hd'/>
Nov 10 22:38:47 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Nov 10 22:38:47 user nova-compute[75288]:   </os>
Nov 10 22:38:47 user nova-compute[75288]:   <features>
Nov 10 22:38:47 user nova-compute[75288]:     <acpi/>
Nov 10 22:38:47 user nova-compute[75288]:     <apic/>
Nov 10 22:38:47 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Nov 10 22:38:47 user nova-compute[75288]:   </features>
Nov 10 22:38:47 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 22:38:47 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Nov 10 22:38:47 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 22:38:47 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Nov 10 22:38:47 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Nov 10 22:38:47 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Nov 10 22:38:47 user nova-compute[75288]:   </cpu>
Nov 10 22:38:47 user nova-compute[75288]:   <clock offset='utc'>
Nov 10 22:38:47 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 22:38:47 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 22:38:47 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Nov 10 22:38:47 user nova-compute[75288]:   </clock>
Nov 10 22:38:47 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Nov 10 22:38:47 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Nov 10 22:38:47 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Nov 10 22:38:47 user nova-compute[75288]:   <devices>
Nov 10 22:38:47 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 22:38:47 user nova-compute[75288]:     <disk type='file' device='disk'>
Nov 10 22:38:47 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 22:38:47 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk' index='2'/>
Nov 10 22:38:47 user nova-compute[75288]:       <backingStore type='file' index='3'>
Nov 10 22:38:47 user nova-compute[75288]:         <format type='raw'/>
Nov 10 22:38:47 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec'/>
Nov 10 22:38:47 user nova-compute[75288]:         <backingStore/>
Nov 10 22:38:47 user nova-compute[75288]:       </backingStore>
Nov 10 22:38:47 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Nov 10 22:38:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </disk>
Nov 10 22:38:47 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Nov 10 22:38:47 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 22:38:47 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config' index='1'/>
Nov 10 22:38:47 user nova-compute[75288]:       <backingStore/>
Nov 10 22:38:47 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Nov 10 22:38:47 user nova-compute[75288]:       <readonly/>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Nov 10 22:38:47 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </disk>
Nov 10 22:38:47 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='usb'/>
Nov 10 22:38:47 user nova-compute[75288]:     </controller>
Nov 10 22:38:47 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='pci.0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </controller>
Nov 10 22:38:47 user nova-compute[75288]:     <controller type='ide' index='0'>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='ide'/>
Nov 10 22:38:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 22:38:47 user nova-compute[75288]:     </controller>
Nov 10 22:38:47 user nova-compute[75288]:     <interface type='ethernet'>
Nov 10 22:38:47 user nova-compute[75288]:       <mac address='fa:16:3e:2c:d0:b2'/>
Nov 10 22:38:47 user nova-compute[75288]:       <target dev='tap9a1df759-b6'/>
Nov 10 22:38:47 user nova-compute[75288]:       <model type='virtio'/>
Nov 10 22:38:47 user nova-compute[75288]:       <mtu size='1442'/>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='net0'/>
Nov 10 22:38:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </interface>
Nov 10 22:38:47 user nova-compute[75288]:     <serial type='pty'>
Nov 10 22:38:47 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:47 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:47 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Nov 10 22:38:47 user nova-compute[75288]:         <model name='isa-serial'/>
Nov 10 22:38:47 user nova-compute[75288]:       </target>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </serial>
Nov 10 22:38:47 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 22:38:47 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:47 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:47 user nova-compute[75288]:       <target type='serial' port='0'/>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </console>
Nov 10 22:38:47 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='input0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </input>
Nov 10 22:38:47 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='input1'/>
Nov 10 22:38:47 user nova-compute[75288]:     </input>
Nov 10 22:38:47 user nova-compute[75288]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 22:38:47 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </graphics>
Nov 10 22:38:47 user nova-compute[75288]:     <audio id='1' type='none'/>
Nov 10 22:38:47 user nova-compute[75288]:     <video>
Nov 10 22:38:47 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='video0'/>
Nov 10 22:38:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </video>
Nov 10 22:38:47 user nova-compute[75288]:     <memballoon model='virtio'>
Nov 10 22:38:47 user nova-compute[75288]:       <stats period='10'/>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='balloon0'/>
Nov 10 22:38:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </memballoon>
Nov 10 22:38:47 user nova-compute[75288]:     <rng model='virtio'>
Nov 10 22:38:47 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Nov 10 22:38:47 user nova-compute[75288]:       <alias name='rng0'/>
Nov 10 22:38:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 22:38:47 user nova-compute[75288]:     </rng>
Nov 10 22:38:47 user nova-compute[75288]:   </devices>
Nov 10 22:38:47 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 22:38:47 user nova-compute[75288]:     <label>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</label>
Nov 10 22:38:47 user nova-compute[75288]:     <imagelabel>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</imagelabel>
Nov 10 22:38:47 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:47 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 22:38:47 user nova-compute[75288]:     <label>+64055:+108</label>
Nov 10 22:38:47 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 22:38:47 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:47 user nova-compute[75288]: </domain>
Nov 10 22:38:47 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 22:38:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully detached device tap52e65878-df from instance d5b1e547-fd1e-432b-a921-59f3c4702c47 from the live domain config.
Nov 10 22:38:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converting VIF {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG os_vif [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e65878-df, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca868670-ed91-4ded-8338-4378b1ee64b4) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:38:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:47 user nova-compute[75288]: INFO os_vif [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df')
Nov 10 22:38:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:38:47 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:creationTime>2023-11-10 22:38:47</nova:creationTime>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Nov 10 22:38:47 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Nov 10 22:38:47 user nova-compute[75288]:   </nova:flavor>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:owner>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:38:47 user nova-compute[75288]:   </nova:owner>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:38:47 user nova-compute[75288]:   <nova:ports>
Nov 10 22:38:47 user nova-compute[75288]:     <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:38:47 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:38:47 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:47 user nova-compute[75288]:   </nova:ports>
Nov 10 22:38:47 user nova-compute[75288]: </nova:instance>
Nov 10 22:38:47 user nova-compute[75288]:  {{(pid=75288) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-deleted-52e65878-df33-444f-a67c-3957c36b598c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:48 user nova-compute[75288]: INFO nova.compute.manager [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Neutron deleted interface 52e65878-df33-444f-a67c-3957c36b598c; detaching it from the instance and deleting it from the info cache
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquired lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.objects.instance [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Lazy-loading 'system_metadata' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.objects.instance [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Lazy-loading 'flavor' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.objects.base [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Object Instance<d5b1e547-fd1e-432b-a921-59f3c4702c47> lazy-loaded attributes: system_metadata,flavor {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Converting VIF {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 10 22:38:48 user nova-compute[75288]:   <name>instance-00000008</name>
Nov 10 22:38:48 user nova-compute[75288]:   <uuid>d5b1e547-fd1e-432b-a921-59f3c4702c47</uuid>
Nov 10 22:38:48 user nova-compute[75288]:   <metadata>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:38:48 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:creationTime>2023-11-10 22:38:47</nova:creationTime>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Nov 10 22:38:48 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:flavor>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:owner>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:owner>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:ports>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:38:48 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:38:48 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:ports>
Nov 10 22:38:48 user nova-compute[75288]: </nova:instance>
Nov 10 22:38:48 user nova-compute[75288]:   </metadata>
Nov 10 22:38:48 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Nov 10 22:38:48 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 22:38:48 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Nov 10 22:38:48 user nova-compute[75288]:   <resource>
Nov 10 22:38:48 user nova-compute[75288]:     <partition>/machine</partition>
Nov 10 22:38:48 user nova-compute[75288]:   </resource>
Nov 10 22:38:48 user nova-compute[75288]:   <sysinfo type='smbios'>
Nov 10 22:38:48 user nova-compute[75288]:     <system>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='serial'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='uuid'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Nov 10 22:38:48 user nova-compute[75288]:     </system>
Nov 10 22:38:48 user nova-compute[75288]:   </sysinfo>
Nov 10 22:38:48 user nova-compute[75288]:   <os>
Nov 10 22:38:48 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 22:38:48 user nova-compute[75288]:     <boot dev='hd'/>
Nov 10 22:38:48 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Nov 10 22:38:48 user nova-compute[75288]:   </os>
Nov 10 22:38:48 user nova-compute[75288]:   <features>
Nov 10 22:38:48 user nova-compute[75288]:     <acpi/>
Nov 10 22:38:48 user nova-compute[75288]:     <apic/>
Nov 10 22:38:48 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Nov 10 22:38:48 user nova-compute[75288]:   </features>
Nov 10 22:38:48 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 22:38:48 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Nov 10 22:38:48 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 22:38:48 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Nov 10 22:38:48 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Nov 10 22:38:48 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Nov 10 22:38:48 user nova-compute[75288]:   </cpu>
Nov 10 22:38:48 user nova-compute[75288]:   <clock offset='utc'>
Nov 10 22:38:48 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 22:38:48 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 22:38:48 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Nov 10 22:38:48 user nova-compute[75288]:   </clock>
Nov 10 22:38:48 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Nov 10 22:38:48 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Nov 10 22:38:48 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Nov 10 22:38:48 user nova-compute[75288]:   <devices>
Nov 10 22:38:48 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 22:38:48 user nova-compute[75288]:     <disk type='file' device='disk'>
Nov 10 22:38:48 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 22:38:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk' index='2'/>
Nov 10 22:38:48 user nova-compute[75288]:       <backingStore type='file' index='3'>
Nov 10 22:38:48 user nova-compute[75288]:         <format type='raw'/>
Nov 10 22:38:48 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec'/>
Nov 10 22:38:48 user nova-compute[75288]:         <backingStore/>
Nov 10 22:38:48 user nova-compute[75288]:       </backingStore>
Nov 10 22:38:48 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </disk>
Nov 10 22:38:48 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Nov 10 22:38:48 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 22:38:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config' index='1'/>
Nov 10 22:38:48 user nova-compute[75288]:       <backingStore/>
Nov 10 22:38:48 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Nov 10 22:38:48 user nova-compute[75288]:       <readonly/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </disk>
Nov 10 22:38:48 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='usb'/>
Nov 10 22:38:48 user nova-compute[75288]:     </controller>
Nov 10 22:38:48 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='pci.0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </controller>
Nov 10 22:38:48 user nova-compute[75288]:     <controller type='ide' index='0'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='ide'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 22:38:48 user nova-compute[75288]:     </controller>
Nov 10 22:38:48 user nova-compute[75288]:     <interface type='ethernet'>
Nov 10 22:38:48 user nova-compute[75288]:       <mac address='fa:16:3e:2c:d0:b2'/>
Nov 10 22:38:48 user nova-compute[75288]:       <target dev='tap9a1df759-b6'/>
Nov 10 22:38:48 user nova-compute[75288]:       <model type='virtio'/>
Nov 10 22:38:48 user nova-compute[75288]:       <mtu size='1442'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='net0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </interface>
Nov 10 22:38:48 user nova-compute[75288]:     <serial type='pty'>
Nov 10 22:38:48 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:48 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Nov 10 22:38:48 user nova-compute[75288]:         <model name='isa-serial'/>
Nov 10 22:38:48 user nova-compute[75288]:       </target>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </serial>
Nov 10 22:38:48 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 22:38:48 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:48 user nova-compute[75288]:       <target type='serial' port='0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </console>
Nov 10 22:38:48 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='input0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </input>
Nov 10 22:38:48 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='input1'/>
Nov 10 22:38:48 user nova-compute[75288]:     </input>
Nov 10 22:38:48 user nova-compute[75288]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 22:38:48 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </graphics>
Nov 10 22:38:48 user nova-compute[75288]:     <audio id='1' type='none'/>
Nov 10 22:38:48 user nova-compute[75288]:     <video>
Nov 10 22:38:48 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='video0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </video>
Nov 10 22:38:48 user nova-compute[75288]:     <memballoon model='virtio'>
Nov 10 22:38:48 user nova-compute[75288]:       <stats period='10'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='balloon0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </memballoon>
Nov 10 22:38:48 user nova-compute[75288]:     <rng model='virtio'>
Nov 10 22:38:48 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='rng0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </rng>
Nov 10 22:38:48 user nova-compute[75288]:   </devices>
Nov 10 22:38:48 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 22:38:48 user nova-compute[75288]:     <label>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</label>
Nov 10 22:38:48 user nova-compute[75288]:     <imagelabel>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</imagelabel>
Nov 10 22:38:48 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:48 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 22:38:48 user nova-compute[75288]:     <label>+64055:+108</label>
Nov 10 22:38:48 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 22:38:48 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:48 user nova-compute[75288]: </domain>
Nov 10 22:38:48 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5f:37:a5"/><model type="virtio"/><mtu size="1442"/><target dev="tap52e65878-df"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 10 22:38:48 user nova-compute[75288]:   <name>instance-00000008</name>
Nov 10 22:38:48 user nova-compute[75288]:   <uuid>d5b1e547-fd1e-432b-a921-59f3c4702c47</uuid>
Nov 10 22:38:48 user nova-compute[75288]:   <metadata>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:38:48 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:creationTime>2023-11-10 22:38:47</nova:creationTime>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Nov 10 22:38:48 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:flavor>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:owner>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:owner>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:ports>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:38:48 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:38:48 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:ports>
Nov 10 22:38:48 user nova-compute[75288]: </nova:instance>
Nov 10 22:38:48 user nova-compute[75288]:   </metadata>
Nov 10 22:38:48 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Nov 10 22:38:48 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 22:38:48 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Nov 10 22:38:48 user nova-compute[75288]:   <resource>
Nov 10 22:38:48 user nova-compute[75288]:     <partition>/machine</partition>
Nov 10 22:38:48 user nova-compute[75288]:   </resource>
Nov 10 22:38:48 user nova-compute[75288]:   <sysinfo type='smbios'>
Nov 10 22:38:48 user nova-compute[75288]:     <system>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='serial'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='uuid'>d5b1e547-fd1e-432b-a921-59f3c4702c47</entry>
Nov 10 22:38:48 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Nov 10 22:38:48 user nova-compute[75288]:     </system>
Nov 10 22:38:48 user nova-compute[75288]:   </sysinfo>
Nov 10 22:38:48 user nova-compute[75288]:   <os>
Nov 10 22:38:48 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 22:38:48 user nova-compute[75288]:     <boot dev='hd'/>
Nov 10 22:38:48 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Nov 10 22:38:48 user nova-compute[75288]:   </os>
Nov 10 22:38:48 user nova-compute[75288]:   <features>
Nov 10 22:38:48 user nova-compute[75288]:     <acpi/>
Nov 10 22:38:48 user nova-compute[75288]:     <apic/>
Nov 10 22:38:48 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Nov 10 22:38:48 user nova-compute[75288]:   </features>
Nov 10 22:38:48 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 22:38:48 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Nov 10 22:38:48 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 22:38:48 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Nov 10 22:38:48 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Nov 10 22:38:48 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Nov 10 22:38:48 user nova-compute[75288]:   </cpu>
Nov 10 22:38:48 user nova-compute[75288]:   <clock offset='utc'>
Nov 10 22:38:48 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 22:38:48 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 22:38:48 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Nov 10 22:38:48 user nova-compute[75288]:   </clock>
Nov 10 22:38:48 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Nov 10 22:38:48 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Nov 10 22:38:48 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Nov 10 22:38:48 user nova-compute[75288]:   <devices>
Nov 10 22:38:48 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 22:38:48 user nova-compute[75288]:     <disk type='file' device='disk'>
Nov 10 22:38:48 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 22:38:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk' index='2'/>
Nov 10 22:38:48 user nova-compute[75288]:       <backingStore type='file' index='3'>
Nov 10 22:38:48 user nova-compute[75288]:         <format type='raw'/>
Nov 10 22:38:48 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec'/>
Nov 10 22:38:48 user nova-compute[75288]:         <backingStore/>
Nov 10 22:38:48 user nova-compute[75288]:       </backingStore>
Nov 10 22:38:48 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </disk>
Nov 10 22:38:48 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Nov 10 22:38:48 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 22:38:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/disk.config' index='1'/>
Nov 10 22:38:48 user nova-compute[75288]:       <backingStore/>
Nov 10 22:38:48 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Nov 10 22:38:48 user nova-compute[75288]:       <readonly/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </disk>
Nov 10 22:38:48 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='usb'/>
Nov 10 22:38:48 user nova-compute[75288]:     </controller>
Nov 10 22:38:48 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='pci.0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </controller>
Nov 10 22:38:48 user nova-compute[75288]:     <controller type='ide' index='0'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='ide'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 22:38:48 user nova-compute[75288]:     </controller>
Nov 10 22:38:48 user nova-compute[75288]:     <interface type='ethernet'>
Nov 10 22:38:48 user nova-compute[75288]:       <mac address='fa:16:3e:2c:d0:b2'/>
Nov 10 22:38:48 user nova-compute[75288]:       <target dev='tap9a1df759-b6'/>
Nov 10 22:38:48 user nova-compute[75288]:       <model type='virtio'/>
Nov 10 22:38:48 user nova-compute[75288]:       <mtu size='1442'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='net0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </interface>
Nov 10 22:38:48 user nova-compute[75288]:     <serial type='pty'>
Nov 10 22:38:48 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:48 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Nov 10 22:38:48 user nova-compute[75288]:         <model name='isa-serial'/>
Nov 10 22:38:48 user nova-compute[75288]:       </target>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </serial>
Nov 10 22:38:48 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 22:38:48 user nova-compute[75288]:       <source path='/dev/pts/7'/>
Nov 10 22:38:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47/console.log' append='off'/>
Nov 10 22:38:48 user nova-compute[75288]:       <target type='serial' port='0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='serial0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </console>
Nov 10 22:38:48 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='input0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </input>
Nov 10 22:38:48 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='input1'/>
Nov 10 22:38:48 user nova-compute[75288]:     </input>
Nov 10 22:38:48 user nova-compute[75288]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 22:38:48 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </graphics>
Nov 10 22:38:48 user nova-compute[75288]:     <audio id='1' type='none'/>
Nov 10 22:38:48 user nova-compute[75288]:     <video>
Nov 10 22:38:48 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='video0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </video>
Nov 10 22:38:48 user nova-compute[75288]:     <memballoon model='virtio'>
Nov 10 22:38:48 user nova-compute[75288]:       <stats period='10'/>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='balloon0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </memballoon>
Nov 10 22:38:48 user nova-compute[75288]:     <rng model='virtio'>
Nov 10 22:38:48 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Nov 10 22:38:48 user nova-compute[75288]:       <alias name='rng0'/>
Nov 10 22:38:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 22:38:48 user nova-compute[75288]:     </rng>
Nov 10 22:38:48 user nova-compute[75288]:   </devices>
Nov 10 22:38:48 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 22:38:48 user nova-compute[75288]:     <label>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</label>
Nov 10 22:38:48 user nova-compute[75288]:     <imagelabel>libvirt-d5b1e547-fd1e-432b-a921-59f3c4702c47</imagelabel>
Nov 10 22:38:48 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:48 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 22:38:48 user nova-compute[75288]:     <label>+64055:+108</label>
Nov 10 22:38:48 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 22:38:48 user nova-compute[75288]:   </seclabel>
Nov 10 22:38:48 user nova-compute[75288]: </domain>
Nov 10 22:38:48 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 22:38:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Detaching interface fa:16:3e:5f:37:a5 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap52e65878-df' not found.
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Converting VIF {"id": "52e65878-df33-444f-a67c-3957c36b598c", "address": "fa:16:3e:5f:37:a5", "network": {"id": "be222ed8-a951-4a11-b004-6e15c9f62f40", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1159090453", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e65878-df", "ovs_interfaceid": "52e65878-df33-444f-a67c-3957c36b598c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG os_vif [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e65878-df, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:48 user nova-compute[75288]: INFO os_vif [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=52e65878-df33-444f-a67c-3957c36b598c,network=Network(be222ed8-a951-4a11-b004-6e15c9f62f40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e65878-df')
Nov 10 22:38:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-cdc901ab-9e67-42b0-b41c-89c062af76a8 req-c3e5574a-d1e7-4d8c-aead-78d09b0eea94 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:38:48 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1538631651</nova:name>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:creationTime>2023-11-10 22:38:48</nova:creationTime>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Nov 10 22:38:48 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:flavor>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:owner>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:user uuid="b68e6d2a49c74a6f8deb59ad6074a0b2">tempest-TaggedAttachmentsTest-2050837664-project-member</nova:user>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:project uuid="2928ef09385a4ebd9e95b8b440865065">tempest-TaggedAttachmentsTest-2050837664</nova:project>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:owner>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:38:48 user nova-compute[75288]:   <nova:ports>
Nov 10 22:38:48 user nova-compute[75288]:     <nova:port uuid="9a1df759-b656-4c5e-af6f-746ce89aefca">
Nov 10 22:38:48 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:38:48 user nova-compute[75288]:     </nova:port>
Nov 10 22:38:48 user nova-compute[75288]:   </nova:ports>
Nov 10 22:38:48 user nova-compute[75288]: </nova:instance>
Nov 10 22:38:48 user nova-compute[75288]:  {{(pid=75288) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 22:38:49 user nova-compute[75288]: INFO nova.network.neutron [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Port 52e65878-df33-444f-a67c-3957c36b598c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 10 22:38:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [{"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Releasing lock "refresh_cache-d5b1e547-fd1e-432b-a921-59f3c4702c47" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ebde5b52-0809-4c1f-8430-eb8a0ab95393 tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "interface-d5b1e547-fd1e-432b-a921-59f3c4702c47-52e65878-df33-444f-a67c-3957c36b598c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.155s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "6b644952-4e1b-4df1-8923-462b988306ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:38:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:38:50 user nova-compute[75288]: INFO nova.compute.claims [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Claim successful on node user
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:38:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.policy [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe464c9138840019ac3a32c3c9bcfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ddead166794fd4b660457f109f7bc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:38:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Creating image(s)
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "/opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "/opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk 1073741824" returned: 0 in 0.060s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Successfully created port: 02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Cannot resize image /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Ensure instance console log exists: /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Successfully updated port: 02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "refresh_cache-6b644952-4e1b-4df1-8923-462b988306ee" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquired lock "refresh_cache-6b644952-4e1b-4df1-8923-462b988306ee" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-changed-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Refreshing instance network info cache due to event network-changed-02286fd6-e3fa-47b9-b4d8-7c4d3e596033. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] Acquiring lock "refresh_cache-6b644952-4e1b-4df1-8923-462b988306ee" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.objects.instance [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'pci_requests' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:52 user nova-compute[75288]: DEBUG nova.objects.instance [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'numa_topology' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:38:53 user nova-compute[75288]: INFO nova.compute.claims [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Claim successful on node user
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Updating instance_info_cache with network_info: [{"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Releasing lock "refresh_cache-6b644952-4e1b-4df1-8923-462b988306ee" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Instance network_info: |[{"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] Acquired lock "refresh_cache-6b644952-4e1b-4df1-8923-462b988306ee" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Refreshing network info cache for port 02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Start _get_guest_xml network_info=[{"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:38:53 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:38:53 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1257552266',display_name='tempest-VolumesAdminNegativeTest-server-1257552266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1257552266',id=14,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ddead166794fd4b660457f109f7bc3',ramdisk_id='',reservation_id='r-3mpegjr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1375484400',owner_user_name='tempest-VolumesAdminNegativeTest-1375484400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:38:51Z,user_data=None,user_id='8fe464c9138840019ac3a32c3c9bcfab',uuid=6b644952-4e1b-4df1-8923-462b988306ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converting VIF {"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a6:fc,bridge_name='br-int',has_traffic_filtering=True,id=02286fd6-e3fa-47b9-b4d8-7c4d3e596033,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02286fd6-e3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b644952-4e1b-4df1-8923-462b988306ee {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:38:53 user nova-compute[75288]:   <uuid>6b644952-4e1b-4df1-8923-462b988306ee</uuid>
Nov 10 22:38:53 user nova-compute[75288]:   <name>instance-0000000e</name>
Nov 10 22:38:53 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:38:53 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:38:53 user nova-compute[75288]:   <metadata>
Nov 10 22:38:53 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:38:53 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:38:53 user nova-compute[75288]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1257552266</nova:name>
Nov 10 22:38:53 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:38:53</nova:creationTime>
Nov 10 22:38:53 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:38:53 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:38:53 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:38:53 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:38:53 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:38:53 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:38:53 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:38:53 user nova-compute[75288]:       <nova:owner>
Nov 10 22:38:53 user nova-compute[75288]:         <nova:user uuid="8fe464c9138840019ac3a32c3c9bcfab">tempest-VolumesAdminNegativeTest-1375484400-project-member</nova:user>
Nov 10 22:38:53 user nova-compute[75288]:         <nova:project uuid="70ddead166794fd4b660457f109f7bc3">tempest-VolumesAdminNegativeTest-1375484400</nova:project>
Nov 10 22:38:53 user nova-compute[75288]:       </nova:owner>
Nov 10 22:38:53 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:38:53 user nova-compute[75288]:       <nova:ports>
Nov 10 22:38:53 user nova-compute[75288]:         <nova:port uuid="02286fd6-e3fa-47b9-b4d8-7c4d3e596033">
Nov 10 22:38:53 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 22:38:53 user nova-compute[75288]:         </nova:port>
Nov 10 22:38:53 user nova-compute[75288]:       </nova:ports>
Nov 10 22:38:53 user nova-compute[75288]:     </nova:instance>
Nov 10 22:38:53 user nova-compute[75288]:   </metadata>
Nov 10 22:38:53 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:38:53 user nova-compute[75288]:     <system>
Nov 10 22:38:53 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:38:53 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:38:53 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:38:53 user nova-compute[75288]:       <entry name="serial">6b644952-4e1b-4df1-8923-462b988306ee</entry>
Nov 10 22:38:53 user nova-compute[75288]:       <entry name="uuid">6b644952-4e1b-4df1-8923-462b988306ee</entry>
Nov 10 22:38:53 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:38:53 user nova-compute[75288]:     </system>
Nov 10 22:38:53 user nova-compute[75288]:   </sysinfo>
Nov 10 22:38:53 user nova-compute[75288]:   <os>
Nov 10 22:38:53 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:38:53 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:38:53 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:38:53 user nova-compute[75288]:   </os>
Nov 10 22:38:53 user nova-compute[75288]:   <features>
Nov 10 22:38:53 user nova-compute[75288]:     <acpi/>
Nov 10 22:38:53 user nova-compute[75288]:     <apic/>
Nov 10 22:38:53 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:38:53 user nova-compute[75288]:   </features>
Nov 10 22:38:53 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:38:53 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:38:53 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:38:53 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:38:53 user nova-compute[75288]:   </clock>
Nov 10 22:38:53 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:38:53 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:38:53 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:38:53 user nova-compute[75288]:   </cpu>
Nov 10 22:38:53 user nova-compute[75288]:   <devices>
Nov 10 22:38:53 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:38:53 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:38:53 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk"/>
Nov 10 22:38:53 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:38:53 user nova-compute[75288]:     </disk>
Nov 10 22:38:53 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:38:53 user nova-compute[75288]:       <mac address="fa:16:3e:a0:a6:fc"/>
Nov 10 22:38:53 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:38:53 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:38:53 user nova-compute[75288]:       <target dev="tap02286fd6-e3"/>
Nov 10 22:38:53 user nova-compute[75288]:     </interface>
Nov 10 22:38:53 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:38:53 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/console.log" append="off"/>
Nov 10 22:38:53 user nova-compute[75288]:     </serial>
Nov 10 22:38:53 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:38:53 user nova-compute[75288]:     <video>
Nov 10 22:38:53 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:38:53 user nova-compute[75288]:     </video>
Nov 10 22:38:53 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:38:53 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:38:53 user nova-compute[75288]:     </rng>
Nov 10 22:38:53 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:38:53 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:38:53 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:38:53 user nova-compute[75288]:     </memballoon>
Nov 10 22:38:53 user nova-compute[75288]:   </devices>
Nov 10 22:38:53 user nova-compute[75288]: </domain>
Nov 10 22:38:53 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1257552266',display_name='tempest-VolumesAdminNegativeTest-server-1257552266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1257552266',id=14,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70ddead166794fd4b660457f109f7bc3',ramdisk_id='',reservation_id='r-3mpegjr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1375484400',owner_user_name='tempest-VolumesAdminNegativeTest-1375484400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:38:51Z,user_data=None,user_id='8fe464c9138840019ac3a32c3c9bcfab',uuid=6b644952-4e1b-4df1-8923-462b988306ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converting VIF {"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a6:fc,bridge_name='br-int',has_traffic_filtering=True,id=02286fd6-e3fa-47b9-b4d8-7c4d3e596033,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02286fd6-e3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG os_vif [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a6:fc,bridge_name='br-int',has_traffic_filtering=True,id=02286fd6-e3fa-47b9-b4d8-7c4d3e596033,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02286fd6-e3') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a323323-d643-5660-9184-5d6850266ef8', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02286fd6-e3, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02286fd6-e3, col_values=(('qos', UUID('ab71f17b-e6b6-4f7d-9f7d-08d532d2695e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02286fd6-e3, col_values=(('external_ids', {'iface-id': '02286fd6-e3fa-47b9-b4d8-7c4d3e596033', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:a6:fc', 'vm-uuid': '6b644952-4e1b-4df1-8923-462b988306ee'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:53 user nova-compute[75288]: INFO os_vif [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a6:fc,bridge_name='br-int',has_traffic_filtering=True,id=02286fd6-e3fa-47b9-b4d8-7c4d3e596033,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02286fd6-e3')
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] No VIF found with MAC fa:16:3e:a0:a6:fc, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Updated VIF entry in instance network info cache for port 02286fd6-e3fa-47b9-b4d8-7c4d3e596033. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Updating instance_info_cache with network_info: [{"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9d427f97-dddd-4116-b7b7-5414c4dedfc9 req-cab50da2-95ea-4715-a5f5-12f51229dcc3 service nova] Releasing lock "refresh_cache-6b644952-4e1b-4df1-8923-462b988306ee" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:53 user nova-compute[75288]: INFO nova.network.neutron [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating port 0404036a-dd85-4ebb-9d1d-4728ae7270ed with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.volume.cinder [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Update attachment failed for attachment 74141137-0dca-4ab5-8cfc-858dc9f31ef1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-960106d3-b3aa-4cd0-9b25-fe1b8a0e13a2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-960106d3-b3aa-4cd0-9b25-fe1b8a0e13a2)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-960106d3-b3aa-4cd0-9b25-fe1b8a0e13a2)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Traceback (most recent call last):
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     driver_block_device.attach_block_devices(
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     _log_and_attach(device)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     super(DriverVolBlankBlockDevice, self).attach(
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     self._do_attach(context, instance, volume, volume_api,
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     self._volume_attach(context, volume, connector, instance,
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     connection_info = volume_api.attachment_update(
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     res = method(self, ctx, *args, **kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     with excutils.save_and_reraise_exception():
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     self.force_reraise()
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     raise self.value
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     return method.func(obj, *args, **kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     resp = self._update('/attachments/%s' % id, body)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     return self.request(url, method, **kwargs)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f]     raise exceptions.from_response(resp, body)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-960106d3-b3aa-4cd0-9b25-fe1b8a0e13a2)
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [instance: f2b08056-0591-41d9-aad4-76f759b3751f] 
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.claims [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Aborting claim: <nova.compute.claims.Claim object at 0x7f4b201f3fa0> {{(pid=75288) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquired lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.490s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Build of instance f2b08056-0591-41d9-aad4-76f759b3751f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-960106d3-b3aa-4cd0-9b25-fe1b8a0e13a2) {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.utils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Build of instance f2b08056-0591-41d9-aad4-76f759b3751f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75288) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 22:38:54 user nova-compute[75288]: ERROR nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Build of instance f2b08056-0591-41d9-aad4-76f759b3751f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-960106d3-b3aa-4cd0-9b25-fe1b8a0e13a2): nova.exception.BuildAbortException: Build of instance f2b08056-0591-41d9-aad4-76f759b3751f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-960106d3-b3aa-4cd0-9b25-fe1b8a0e13a2)
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Unplugging VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718295392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718295392',id=13,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-pe2rm66y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:38:15Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=f2b08056-0591-41d9-aad4-76f759b3751f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aefd1a4f-3f70-439c-8308-16e34d47e985", "address": "fa:16:3e:c6:77:b8", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefd1a4f-3f", "ovs_interfaceid": "aefd1a4f-3f70-439c-8308-16e34d47e985", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "aefd1a4f-3f70-439c-8308-16e34d47e985", "address": "fa:16:3e:c6:77:b8", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefd1a4f-3f", "ovs_interfaceid": "aefd1a4f-3f70-439c-8308-16e34d47e985", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:b8,bridge_name='br-int',has_traffic_filtering=True,id=aefd1a4f-3f70-439c-8308-16e34d47e985,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefd1a4f-3f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG os_vif [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:b8,bridge_name='br-int',has_traffic_filtering=True,id=aefd1a4f-3f70-439c-8308-16e34d47e985,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefd1a4f-3f') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaefd1a4f-3f, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:38:54 user nova-compute[75288]: INFO os_vif [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:77:b8,bridge_name='br-int',has_traffic_filtering=True,id=aefd1a4f-3f70-439c-8308-16e34d47e985,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefd1a4f-3f')
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Unplugged VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing instance network info cache due to event network-changed-0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] Acquiring lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Releasing lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:38:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Creating image(s)
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'trusted_certs' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] Acquired lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Refreshing network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG nova.objects.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<a1701e0c-f9c9-4ba8-81ec-1b9966e033a3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "49b86586779f0a1245eeddf6a4161ff263a430de" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "49b86586779f0a1245eeddf6a4161ff263a430de" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-4d421ec3-5cc0-4c9f-b532-64b3411b9a9e req-574c7fb1-360a-4eae-950e-59108dc84462 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4d421ec3-5cc0-4c9f-b532-64b3411b9a9e req-574c7fb1-360a-4eae-950e-59108dc84462 service nova] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4d421ec3-5cc0-4c9f-b532-64b3411b9a9e req-574c7fb1-360a-4eae-950e-59108dc84462 service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4d421ec3-5cc0-4c9f-b532-64b3411b9a9e req-574c7fb1-360a-4eae-950e-59108dc84462 service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-4d421ec3-5cc0-4c9f-b532-64b3411b9a9e req-574c7fb1-360a-4eae-950e-59108dc84462 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] No waiting events found dispatching network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:56 user nova-compute[75288]: WARNING nova.compute.manager [req-4d421ec3-5cc0-4c9f-b532-64b3411b9a9e req-574c7fb1-360a-4eae-950e-59108dc84462 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received unexpected event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 for instance with vm_state building and task_state spawning.
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:56 user nova-compute[75288]: INFO nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Took 1.34 seconds to deallocate network for instance.
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Detaching volume: 67c30363-5675-4ea0-9c80-5b821a4028a7 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 22:38:56 user nova-compute[75288]: INFO nova.compute.manager [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Detaching volume 67c30363-5675-4ea0-9c80-5b821a4028a7
Nov 10 22:38:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.part --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.virt.images [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] 095a4252-5e23-47db-a4c0-8fb007c52255 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.part /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: f2b08056-0591-41d9-aad4-76f759b3751f] Skipping driver_detach during remote rebuild. {{(pid=75288) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updated VIF entry in instance network info cache for port 0404036a-dd85-4ebb-9d1d-4728ae7270ed. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:38:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26693e97-e515-4c54-8cbd-e8c0fd3ff983 req-a76bd758-99fa-42fc-b272-3236e03be21b service nova] Releasing lock "refresh_cache-a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c83152c-abdb-448a-9975-adf8c13c453d req-f2ce395e-83b2-44d9-9f9b-34c0b81dba71 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c83152c-abdb-448a-9975-adf8c13c453d req-f2ce395e-83b2-44d9-9f9b-34c0b81dba71 service nova] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c83152c-abdb-448a-9975-adf8c13c453d req-f2ce395e-83b2-44d9-9f9b-34c0b81dba71 service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c83152c-abdb-448a-9975-adf8c13c453d req-f2ce395e-83b2-44d9-9f9b-34c0b81dba71 service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c83152c-abdb-448a-9975-adf8c13c453d req-f2ce395e-83b2-44d9-9f9b-34c0b81dba71 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] No waiting events found dispatching network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:38:57 user nova-compute[75288]: WARNING nova.compute.manager [req-0c83152c-abdb-448a-9975-adf8c13c453d req-f2ce395e-83b2-44d9-9f9b-34c0b81dba71 service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received unexpected event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 for instance with vm_state building and task_state spawning.
Nov 10 22:38:57 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Deleted allocations for instance f2b08056-0591-41d9-aad4-76f759b3751f
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6efd8d18-760a-4b75-9335-f2fea3a110f7 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f2b08056-0591-41d9-aad4-76f759b3751f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.010s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.part /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.converted" returned: 0 in 1.081s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "49b86586779f0a1245eeddf6a4161ff263a430de" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.646s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "49b86586779f0a1245eeddf6a4161ff263a430de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "49b86586779f0a1245eeddf6a4161ff263a430de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de,backing_fmt=raw /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:38:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Instance spawned successfully.
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de,backing_fmt=raw /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk 1073741824" returned: 0 in 0.063s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "49b86586779f0a1245eeddf6a4161ff263a430de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:38:58 user nova-compute[75288]: INFO nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'migration_context' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<a1701e0c-f9c9-4ba8-81ec-1b9966e033a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:38:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Rebasing disk image.
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:38:58 user nova-compute[75288]: INFO nova.compute.manager [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Took 7.57 seconds to build instance.
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d94f3ec-6e55-450f-bbc5-867d7a6a999f tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "6b644952-4e1b-4df1-8923-462b988306ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.667s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:38:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec -F raw /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec -F raw /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk" returned: 0 in 3.065s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Ensure instance console log exists: /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Start _get_guest_xml network_info=[{"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='738d7db0ede518aad4e05a5c456be722',container_format='bare',created_at=2023-11-10T22:36:30Z,direct_url=<?>,disk_format='qcow2',id=095a4252-5e23-47db-a4c0-8fb007c52255,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-629412587-shelved',owner='53f6c30d0f1a467f8e977a73463e2d1e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T22:36:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKmSpJHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a1701e0c-f9c9-4ba8-81ec-1b9966e033a3', 'attached_at': '', 'detached_at': '', 'volume_id': '81e85fec-9286-49b5-81a2-ff2bdc4fe547', 'serial': '81e85fec-9286-49b5-81a2-ff2bdc4fe547'}, 'mount_device': '/dev/vdc', 'attachment_id': '4adb1a5f-4361-4605-88c8-44e4c926877e', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:39:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='738d7db0ede518aad4e05a5c456be722',container_format='bare',created_at=2023-11-10T22:36:30Z,direct_url=<?>,disk_format='qcow2',id=095a4252-5e23-47db-a4c0-8fb007c52255,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-629412587-shelved',owner='53f6c30d0f1a467f8e977a73463e2d1e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T22:36:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.objects.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<a1701e0c-f9c9-4ba8-81ec-1b9966e033a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKmSpJHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:39:01 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:01 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:01 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260" returned: 21 in 0.118s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ef76f-396b-4820-8d48-6e023aa752b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:39:01 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f508ffa-277e-4cbd-8150-af24e8b44a34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547] added
Nov 10 22:39:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6835aa-83c7-4b74-9376-6c1f2b530732]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b302d3-b626-43fe-a6f7-5bb4f7726c07]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKmSpJHd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKmSpJHd" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[af63b46c-8d4a-4f06-be0d-843d4f7ade81]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKmSpJHd'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd994e4-e5e5-410d-a40e-9e1ddecc8a3d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf6356e-2348-4c57-90d7-cc97977b9341]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:01 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:01 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:01 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:01 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:01 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:01 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c477aa-60df-44fe-8e16-cbdcf772c90b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260]
Nov 10 22:39:02 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260] successful.
Nov 10 22:39:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddf17d0-191c-4989-b799-8db76595e103]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef95982-c41e-4c91-bdda-203df89e1ebe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:02 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2e0276-410c-4b89-b742-1d2d348fdb46]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:39:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKmSpJHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23761316534306430', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761316534306430', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-629412587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-629412587',id=3,image_ref='095a4252-5e23-47db-a4c0-8fb007c52255',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-864991346',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-qnxqgmhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member',shelved_at='2023-11-10T22:36:35.788504',shelved_host='user',shelved_image_id='095a4252-5e23-47db-a4c0-8fb007c52255'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=a1701e0c-f9c9-4ba8-81ec-1b9966e033a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'pci_devices' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.objects.base [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<a1701e0c-f9c9-4ba8-81ec-1b9966e033a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:39:03 user nova-compute[75288]:   <uuid>a1701e0c-f9c9-4ba8-81ec-1b9966e033a3</uuid>
Nov 10 22:39:03 user nova-compute[75288]:   <name>instance-00000003</name>
Nov 10 22:39:03 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:39:03 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:39:03 user nova-compute[75288]:   <metadata>
Nov 10 22:39:03 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:39:03 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:39:03 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-629412587</nova:name>
Nov 10 22:39:03 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:39:01</nova:creationTime>
Nov 10 22:39:03 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:39:03 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:39:03 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:39:03 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:39:03 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:39:03 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:39:03 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:39:03 user nova-compute[75288]:       <nova:owner>
Nov 10 22:39:03 user nova-compute[75288]:         <nova:user uuid="05f170ae42004d57abea1bf318d05dab">tempest-AttachVolumeShelveTestJSON-1618351090-project-member</nova:user>
Nov 10 22:39:03 user nova-compute[75288]:         <nova:project uuid="53f6c30d0f1a467f8e977a73463e2d1e">tempest-AttachVolumeShelveTestJSON-1618351090</nova:project>
Nov 10 22:39:03 user nova-compute[75288]:       </nova:owner>
Nov 10 22:39:03 user nova-compute[75288]:       <nova:root type="image" uuid="095a4252-5e23-47db-a4c0-8fb007c52255"/>
Nov 10 22:39:03 user nova-compute[75288]:       <nova:ports>
Nov 10 22:39:03 user nova-compute[75288]:         <nova:port uuid="0404036a-dd85-4ebb-9d1d-4728ae7270ed">
Nov 10 22:39:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 22:39:03 user nova-compute[75288]:         </nova:port>
Nov 10 22:39:03 user nova-compute[75288]:       </nova:ports>
Nov 10 22:39:03 user nova-compute[75288]:     </nova:instance>
Nov 10 22:39:03 user nova-compute[75288]:   </metadata>
Nov 10 22:39:03 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:39:03 user nova-compute[75288]:     <system>
Nov 10 22:39:03 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:39:03 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:39:03 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:39:03 user nova-compute[75288]:       <entry name="serial">a1701e0c-f9c9-4ba8-81ec-1b9966e033a3</entry>
Nov 10 22:39:03 user nova-compute[75288]:       <entry name="uuid">a1701e0c-f9c9-4ba8-81ec-1b9966e033a3</entry>
Nov 10 22:39:03 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:39:03 user nova-compute[75288]:     </system>
Nov 10 22:39:03 user nova-compute[75288]:   </sysinfo>
Nov 10 22:39:03 user nova-compute[75288]:   <os>
Nov 10 22:39:03 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:39:03 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:39:03 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:39:03 user nova-compute[75288]:   </os>
Nov 10 22:39:03 user nova-compute[75288]:   <features>
Nov 10 22:39:03 user nova-compute[75288]:     <acpi/>
Nov 10 22:39:03 user nova-compute[75288]:     <apic/>
Nov 10 22:39:03 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:39:03 user nova-compute[75288]:   </features>
Nov 10 22:39:03 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:39:03 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:39:03 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:39:03 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:39:03 user nova-compute[75288]:   </clock>
Nov 10 22:39:03 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:39:03 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:39:03 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:39:03 user nova-compute[75288]:   </cpu>
Nov 10 22:39:03 user nova-compute[75288]:   <devices>
Nov 10 22:39:03 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:39:03 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:39:03 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk"/>
Nov 10 22:39:03 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:39:03 user nova-compute[75288]:     </disk>
Nov 10 22:39:03 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:39:03 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:39:03 user nova-compute[75288]:       <source dev="/dev/sdd"/>
Nov 10 22:39:03 user nova-compute[75288]:       <target dev="vdc" bus="virtio"/>
Nov 10 22:39:03 user nova-compute[75288]:       <serial>81e85fec-9286-49b5-81a2-ff2bdc4fe547</serial>
Nov 10 22:39:03 user nova-compute[75288]:     </disk>
Nov 10 22:39:03 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:39:03 user nova-compute[75288]:       <mac address="fa:16:3e:8b:e8:23"/>
Nov 10 22:39:03 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:03 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:39:03 user nova-compute[75288]:       <target dev="tap0404036a-dd"/>
Nov 10 22:39:03 user nova-compute[75288]:     </interface>
Nov 10 22:39:03 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:39:03 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/console.log" append="off"/>
Nov 10 22:39:03 user nova-compute[75288]:     </serial>
Nov 10 22:39:03 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:39:03 user nova-compute[75288]:     <video>
Nov 10 22:39:03 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:03 user nova-compute[75288]:     </video>
Nov 10 22:39:03 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:39:03 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:39:03 user nova-compute[75288]:     </rng>
Nov 10 22:39:03 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:39:03 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:39:03 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:39:03 user nova-compute[75288]:     </memballoon>
Nov 10 22:39:03 user nova-compute[75288]:   </devices>
Nov 10 22:39:03 user nova-compute[75288]: </domain>
Nov 10 22:39:03 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-629412587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-629412587',id=3,image_ref='095a4252-5e23-47db-a4c0-8fb007c52255',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-864991346',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-qnxqgmhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member',shelved_at='2023-11-10T22:36:35.788504',shelved_host='user',shelved_image_id='095a4252-5e23-47db-a4c0-8fb007c52255'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=a1701e0c-f9c9-4ba8-81ec-1b9966e033a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG os_vif [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '593b81d7-8739-5d74-ab54-60ac628681f9', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0404036a-dd, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0404036a-dd, col_values=(('qos', UUID('d23cca19-aa80-4a4a-8c9c-98ca166b947b')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0404036a-dd, col_values=(('external_ids', {'iface-id': '0404036a-dd85-4ebb-9d1d-4728ae7270ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:e8:23', 'vm-uuid': 'a1701e0c-f9c9-4ba8-81ec-1b9966e033a3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:03 user nova-compute[75288]: INFO os_vif [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd')
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:39:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No VIF found with MAC fa:16:3e:8b:e8:23, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:39:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-aebe27bf-1837-4260-9a5e-57a2f99fb206 req-71f0caf4-4cd4-46ec-a920-fb495dcf16e1 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aebe27bf-1837-4260-9a5e-57a2f99fb206 req-71f0caf4-4cd4-46ec-a920-fb495dcf16e1 service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aebe27bf-1837-4260-9a5e-57a2f99fb206 req-71f0caf4-4cd4-46ec-a920-fb495dcf16e1 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aebe27bf-1837-4260-9a5e-57a2f99fb206 req-71f0caf4-4cd4-46ec-a920-fb495dcf16e1 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-aebe27bf-1837-4260-9a5e-57a2f99fb206 req-71f0caf4-4cd4-46ec-a920-fb495dcf16e1 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:06 user nova-compute[75288]: WARNING nova.compute.manager [req-aebe27bf-1837-4260-9a5e-57a2f99fb206 req-71f0caf4-4cd4-46ec-a920-fb495dcf16e1 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received unexpected event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 22:39:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:39:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:07 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:39:07 user nova-compute[75288]: INFO nova.compute.claims [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Claim successful on node user
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:39:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-7c6e1004-4895-419a-b552-2a19f8d2a498 req-ba47e597-91e4-4d0b-85bf-fe9eb648b86c service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7c6e1004-4895-419a-b552-2a19f8d2a498 req-ba47e597-91e4-4d0b-85bf-fe9eb648b86c service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7c6e1004-4895-419a-b552-2a19f8d2a498 req-ba47e597-91e4-4d0b-85bf-fe9eb648b86c service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7c6e1004-4895-419a-b552-2a19f8d2a498 req-ba47e597-91e4-4d0b-85bf-fe9eb648b86c service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-7c6e1004-4895-419a-b552-2a19f8d2a498 req-ba47e597-91e4-4d0b-85bf-fe9eb648b86c service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:08 user nova-compute[75288]: WARNING nova.compute.manager [req-7c6e1004-4895-419a-b552-2a19f8d2a498 req-ba47e597-91e4-4d0b-85bf-fe9eb648b86c service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received unexpected event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.policy [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07d1ae0425e64057b3b2220d4bb02624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4325393aa3434c2a87912895d4574812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:39:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance spawned successfully.
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:39:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Creating image(s)
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "/opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "/opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.403s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.292s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk 1073741824" returned: 0 in 0.070s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.382s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Successfully created port: 6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-232e3524-76d3-4d63-8031-756c2c42c3e7 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 44.603s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.267s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Cannot resize image /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Ensure instance console log exists: /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Successfully updated port: 6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquired lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received event network-changed-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Refreshing instance network info cache due to event network-changed-6f23a514-be0a-441c-a75d-597d7d48efb1. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] Acquiring lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updating instance_info_cache with network_info: [{"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Releasing lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Instance network_info: |[{"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] Acquired lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Refreshing network info cache for port 6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Start _get_guest_xml network_info=[{"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:39:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1848360599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1848360599',id=15,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-eetk7v5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:39:08Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=9bb377b7-e5a5-480f-9dd9-7d4e650841eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c7:63,bridge_name='br-int',has_traffic_filtering=True,id=6f23a514-be0a-441c-a75d-597d7d48efb1,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f23a514-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bb377b7-e5a5-480f-9dd9-7d4e650841eb {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:39:11 user nova-compute[75288]:   <uuid>9bb377b7-e5a5-480f-9dd9-7d4e650841eb</uuid>
Nov 10 22:39:11 user nova-compute[75288]:   <name>instance-0000000f</name>
Nov 10 22:39:11 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:39:11 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:39:11 user nova-compute[75288]:   <metadata>
Nov 10 22:39:11 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:39:11 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:39:11 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1848360599</nova:name>
Nov 10 22:39:11 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:39:11</nova:creationTime>
Nov 10 22:39:11 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:39:11 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:39:11 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:39:11 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:39:11 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:39:11 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:39:11 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:39:11 user nova-compute[75288]:       <nova:owner>
Nov 10 22:39:11 user nova-compute[75288]:         <nova:user uuid="07d1ae0425e64057b3b2220d4bb02624">tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member</nova:user>
Nov 10 22:39:11 user nova-compute[75288]:         <nova:project uuid="4325393aa3434c2a87912895d4574812">tempest-ServerBootFromVolumeStableRescueTest-244383607</nova:project>
Nov 10 22:39:11 user nova-compute[75288]:       </nova:owner>
Nov 10 22:39:11 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:39:11 user nova-compute[75288]:       <nova:ports>
Nov 10 22:39:11 user nova-compute[75288]:         <nova:port uuid="6f23a514-be0a-441c-a75d-597d7d48efb1">
Nov 10 22:39:11 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 22:39:11 user nova-compute[75288]:         </nova:port>
Nov 10 22:39:11 user nova-compute[75288]:       </nova:ports>
Nov 10 22:39:11 user nova-compute[75288]:     </nova:instance>
Nov 10 22:39:11 user nova-compute[75288]:   </metadata>
Nov 10 22:39:11 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:39:11 user nova-compute[75288]:     <system>
Nov 10 22:39:11 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:39:11 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:39:11 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:39:11 user nova-compute[75288]:       <entry name="serial">9bb377b7-e5a5-480f-9dd9-7d4e650841eb</entry>
Nov 10 22:39:11 user nova-compute[75288]:       <entry name="uuid">9bb377b7-e5a5-480f-9dd9-7d4e650841eb</entry>
Nov 10 22:39:11 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:39:11 user nova-compute[75288]:     </system>
Nov 10 22:39:11 user nova-compute[75288]:   </sysinfo>
Nov 10 22:39:11 user nova-compute[75288]:   <os>
Nov 10 22:39:11 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:39:11 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:39:11 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:39:11 user nova-compute[75288]:   </os>
Nov 10 22:39:11 user nova-compute[75288]:   <features>
Nov 10 22:39:11 user nova-compute[75288]:     <acpi/>
Nov 10 22:39:11 user nova-compute[75288]:     <apic/>
Nov 10 22:39:11 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:39:11 user nova-compute[75288]:   </features>
Nov 10 22:39:11 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:39:11 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:39:11 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:39:11 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:39:11 user nova-compute[75288]:   </clock>
Nov 10 22:39:11 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:39:11 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:39:11 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:39:11 user nova-compute[75288]:   </cpu>
Nov 10 22:39:11 user nova-compute[75288]:   <devices>
Nov 10 22:39:11 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:39:11 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:39:11 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk"/>
Nov 10 22:39:11 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:39:11 user nova-compute[75288]:     </disk>
Nov 10 22:39:11 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:39:11 user nova-compute[75288]:       <mac address="fa:16:3e:cf:c7:63"/>
Nov 10 22:39:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:11 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:39:11 user nova-compute[75288]:       <target dev="tap6f23a514-be"/>
Nov 10 22:39:11 user nova-compute[75288]:     </interface>
Nov 10 22:39:11 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:39:11 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/console.log" append="off"/>
Nov 10 22:39:11 user nova-compute[75288]:     </serial>
Nov 10 22:39:11 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:39:11 user nova-compute[75288]:     <video>
Nov 10 22:39:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:11 user nova-compute[75288]:     </video>
Nov 10 22:39:11 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:39:11 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:39:11 user nova-compute[75288]:     </rng>
Nov 10 22:39:11 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:39:11 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:39:11 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:39:11 user nova-compute[75288]:     </memballoon>
Nov 10 22:39:11 user nova-compute[75288]:   </devices>
Nov 10 22:39:11 user nova-compute[75288]: </domain>
Nov 10 22:39:11 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1848360599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1848360599',id=15,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-eetk7v5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:39:08Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=9bb377b7-e5a5-480f-9dd9-7d4e650841eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c7:63,bridge_name='br-int',has_traffic_filtering=True,id=6f23a514-be0a-441c-a75d-597d7d48efb1,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f23a514-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG os_vif [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c7:63,bridge_name='br-int',has_traffic_filtering=True,id=6f23a514-be0a-441c-a75d-597d7d48efb1,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f23a514-be') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43117343-cefc-5f4e-972f-6214e320da02', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f23a514-be, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f23a514-be, col_values=(('qos', UUID('dc940647-b9d6-43ba-9ada-a4c38bb8ce63')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f23a514-be, col_values=(('external_ids', {'iface-id': '6f23a514-be0a-441c-a75d-597d7d48efb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c7:63', 'vm-uuid': '9bb377b7-e5a5-480f-9dd9-7d4e650841eb'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:11 user nova-compute[75288]: INFO os_vif [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c7:63,bridge_name='br-int',has_traffic_filtering=True,id=6f23a514-be0a-441c-a75d-597d7d48efb1,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f23a514-be')
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No VIF found with MAC fa:16:3e:cf:c7:63, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updated VIF entry in instance network info cache for port 6f23a514-be0a-441c-a75d-597d7d48efb1. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updating instance_info_cache with network_info: [{"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7ff0fb1-1e83-4493-806d-e42bf2e11a39 req-11f5f04a-bed2-480f-933d-57bf16f07fc4 service nova] Releasing lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-a957c7d9-52b6-4101-9d30-a80c04be3563 req-f74f98fd-9f47-481f-b46b-1a5650b7bb5a service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received event network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a957c7d9-52b6-4101-9d30-a80c04be3563 req-f74f98fd-9f47-481f-b46b-1a5650b7bb5a service nova] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a957c7d9-52b6-4101-9d30-a80c04be3563 req-f74f98fd-9f47-481f-b46b-1a5650b7bb5a service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a957c7d9-52b6-4101-9d30-a80c04be3563 req-f74f98fd-9f47-481f-b46b-1a5650b7bb5a service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-a957c7d9-52b6-4101-9d30-a80c04be3563 req-f74f98fd-9f47-481f-b46b-1a5650b7bb5a service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] No waiting events found dispatching network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:13 user nova-compute[75288]: WARNING nova.compute.manager [req-a957c7d9-52b6-4101-9d30-a80c04be3563 req-f74f98fd-9f47-481f-b46b-1a5650b7bb5a service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received unexpected event network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 for instance with vm_state building and task_state spawning.
Nov 10 22:39:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-e5e71aaf-a921-4960-a6de-556bcc2bbc14 req-41c5bfaa-c97a-471b-ac9b-29f3ef570455 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received event network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e5e71aaf-a921-4960-a6de-556bcc2bbc14 req-41c5bfaa-c97a-471b-ac9b-29f3ef570455 service nova] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e5e71aaf-a921-4960-a6de-556bcc2bbc14 req-41c5bfaa-c97a-471b-ac9b-29f3ef570455 service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e5e71aaf-a921-4960-a6de-556bcc2bbc14 req-41c5bfaa-c97a-471b-ac9b-29f3ef570455 service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-e5e71aaf-a921-4960-a6de-556bcc2bbc14 req-41c5bfaa-c97a-471b-ac9b-29f3ef570455 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] No waiting events found dispatching network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:15 user nova-compute[75288]: WARNING nova.compute.manager [req-e5e71aaf-a921-4960-a6de-556bcc2bbc14 req-41c5bfaa-c97a-471b-ac9b-29f3ef570455 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received unexpected event network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 for instance with vm_state building and task_state spawning.
Nov 10 22:39:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:39:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:39:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Instance spawned successfully.
Nov 10 22:39:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:16 user nova-compute[75288]: INFO nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Took 7.62 seconds to spawn the instance on the hypervisor.
Nov 10 22:39:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:39:16 user nova-compute[75288]: INFO nova.compute.manager [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Took 8.68 seconds to build instance.
Nov 10 22:39:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d209dc30-fb99-46b3-bbd3-f7e1880a73a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.792s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:18 user nova-compute[75288]: INFO nova.compute.manager [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Terminating instance
Nov 10 22:39:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf40bc68-d026-40ef-88d8-7d626ca0d214 req-9637b55c-bec4-4618-8cc0-4417458d7be8 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-unplugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf40bc68-d026-40ef-88d8-7d626ca0d214 req-9637b55c-bec4-4618-8cc0-4417458d7be8 service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf40bc68-d026-40ef-88d8-7d626ca0d214 req-9637b55c-bec4-4618-8cc0-4417458d7be8 service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf40bc68-d026-40ef-88d8-7d626ca0d214 req-9637b55c-bec4-4618-8cc0-4417458d7be8 service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf40bc68-d026-40ef-88d8-7d626ca0d214 req-9637b55c-bec4-4618-8cc0-4417458d7be8 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-unplugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf40bc68-d026-40ef-88d8-7d626ca0d214 req-9637b55c-bec4-4618-8cc0-4417458d7be8 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-unplugged-9a1df759-b656-4c5e-af6f-746ce89aefca for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Instance destroyed successfully.
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lazy-loading 'resources' on Instance uuid d5b1e547-fd1e-432b-a921-59f3c4702c47 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1538631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1538631651',id=8,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL801//bkNSy5gbbJZrHR0ASXftlRSGDjH83JZW/aP/lFtDwmSMHCFtKZAHYy9ja+WCD/zoeCsqxrM3SKZaq3FM9UPj7ZuzFIDcoURbKhBJekuIFLIJbX4zlo/AUKPRiew==',key_name='tempest-keypair-1419160743',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2928ef09385a4ebd9e95b8b440865065',ramdisk_id='',reservation_id='r-vtx2m9d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2050837664',owner_user_name='tempest-TaggedAttachmentsTest-2050837664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b68e6d2a49c74a6f8deb59ad6074a0b2',uuid=d5b1e547-fd1e-432b-a921-59f3c4702c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converting VIF {"id": "9a1df759-b656-4c5e-af6f-746ce89aefca", "address": "fa:16:3e:2c:d0:b2", "network": {"id": "126d6040-2de3-4813-b64c-a939ab148beb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-238746734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2928ef09385a4ebd9e95b8b440865065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1df759-b6", "ovs_interfaceid": "9a1df759-b656-4c5e-af6f-746ce89aefca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=9a1df759-b656-4c5e-af6f-746ce89aefca,network=Network(126d6040-2de3-4813-b64c-a939ab148beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1df759-b6') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG os_vif [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=9a1df759-b656-4c5e-af6f-746ce89aefca,network=Network(126d6040-2de3-4813-b64c-a939ab148beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1df759-b6') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a1df759-b6, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=805d764b-1a20-461e-bca3-f0f918b87671) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:19 user nova-compute[75288]: INFO os_vif [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=9a1df759-b656-4c5e-af6f-746ce89aefca,network=Network(126d6040-2de3-4813-b64c-a939ab148beb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1df759-b6')
Nov 10 22:39:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Deleting instance files /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47_del
Nov 10 22:39:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Deletion of /opt/stack/data/nova/instances/d5b1e547-fd1e-432b-a921-59f3c4702c47_del complete
Nov 10 22:39:19 user nova-compute[75288]: INFO nova.compute.manager [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 10 22:39:19 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 80788251-eb95-4022-8170-d219f083c64f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updating instance_info_cache with network_info: [{"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:20 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Took 1.18 seconds to deallocate network for instance.
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-695ce2b9-7a17-4127-97a0-8dfbdb66e2ef req-b95d74ae-f66e-4f66-9c4e-d4475a829e5b service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-deleted-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:20 user nova-compute[75288]: INFO nova.compute.manager [req-695ce2b9-7a17-4127-97a0-8dfbdb66e2ef req-b95d74ae-f66e-4f66-9c4e-d4475a829e5b service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Neutron deleted interface 9a1df759-b656-4c5e-af6f-746ce89aefca; detaching it from the instance and deleting it from the info cache
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-695ce2b9-7a17-4127-97a0-8dfbdb66e2ef req-b95d74ae-f66e-4f66-9c4e-d4475a829e5b service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-80788251-eb95-4022-8170-d219f083c64f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-695ce2b9-7a17-4127-97a0-8dfbdb66e2ef req-b95d74ae-f66e-4f66-9c4e-d4475a829e5b service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Detach interface failed, port_id=9a1df759-b656-4c5e-af6f-746ce89aefca, reason: Instance d5b1e547-fd1e-432b-a921-59f3c4702c47 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-61297a94-ad37-4aa3-b344-edc0e74de198 req-3e69bf11-5f3d-4988-8338-afe17c7b86a1 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received event network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61297a94-ad37-4aa3-b344-edc0e74de198 req-3e69bf11-5f3d-4988-8338-afe17c7b86a1 service nova] Acquiring lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61297a94-ad37-4aa3-b344-edc0e74de198 req-3e69bf11-5f3d-4988-8338-afe17c7b86a1 service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-61297a94-ad37-4aa3-b344-edc0e74de198 req-3e69bf11-5f3d-4988-8338-afe17c7b86a1 service nova] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-61297a94-ad37-4aa3-b344-edc0e74de198 req-3e69bf11-5f3d-4988-8338-afe17c7b86a1 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] No waiting events found dispatching network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:20 user nova-compute[75288]: WARNING nova.compute.manager [req-61297a94-ad37-4aa3-b344-edc0e74de198 req-3e69bf11-5f3d-4988-8338-afe17c7b86a1 service nova] [instance: d5b1e547-fd1e-432b-a921-59f3c4702c47] Received unexpected event network-vif-plugged-9a1df759-b656-4c5e-af6f-746ce89aefca for instance with vm_state deleted and task_state None.
Nov 10 22:39:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:21 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Deleted allocations for instance d5b1e547-fd1e-432b-a921-59f3c4702c47
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3cbd5b1-52b8-449f-9948-ab9da6db419a tempest-TaggedAttachmentsTest-2050837664 tempest-TaggedAttachmentsTest-2050837664-project-member] Lock "d5b1e547-fd1e-432b-a921-59f3c4702c47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.157s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:39:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:39:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:39:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7728MB free_disk=25.493988037109375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 80788251-eb95-4022-8170-d219f083c64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7e41f40b-859f-4239-b5e5-a787af7e28ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 6b644952-4e1b-4df1-8923-462b988306ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:39:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:39:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:29 user nova-compute[75288]: INFO nova.compute.manager [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Terminating instance
Nov 10 22:39:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-db953c85-b456-4d72-92a8-ca4410930272 req-72c4c72d-55d0-48eb-8383-b13e50da65e4 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-vif-unplugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db953c85-b456-4d72-92a8-ca4410930272 req-72c4c72d-55d0-48eb-8383-b13e50da65e4 service nova] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db953c85-b456-4d72-92a8-ca4410930272 req-72c4c72d-55d0-48eb-8383-b13e50da65e4 service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db953c85-b456-4d72-92a8-ca4410930272 req-72c4c72d-55d0-48eb-8383-b13e50da65e4 service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-db953c85-b456-4d72-92a8-ca4410930272 req-72c4c72d-55d0-48eb-8383-b13e50da65e4 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] No waiting events found dispatching network-vif-unplugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-db953c85-b456-4d72-92a8-ca4410930272 req-72c4c72d-55d0-48eb-8383-b13e50da65e4 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-vif-unplugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Instance destroyed successfully.
Nov 10 22:39:30 user nova-compute[75288]: DEBUG nova.objects.instance [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lazy-loading 'resources' on Instance uuid 5e3770a5-16c7-4b7e-8826-ebd2861085b4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-948841717',display_name='tempest-VolumesAssistedSnapshotsTest-server-948841717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-948841717',id=9,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUxqYFXebKbzz3MZfOKRjqfYE6IngpmYUGeyQcrBtFXyqfnfY1bvKWSWiJ5uizdpkULKkZRoy2IeW6b6Fd4o4gpn3AlNUZ5Pzn+pMbGuMQPSkBXtL9dexdULCGUxNUJHQ==',key_name='tempest-keypair-1998331293',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046e40def5c44f60bace530257d51eb2',ramdisk_id='',reservation_id='r-agueb6nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1489622189',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1489622189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9852766749f2436b82672bf33c38589f',uuid=5e3770a5-16c7-4b7e-8826-ebd2861085b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Converting VIF {"id": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "address": "fa:16:3e:f8:05:f5", "network": {"id": "80c98901-f52b-4c61-9065-127a9889eb15", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-786858274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "046e40def5c44f60bace530257d51eb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf64e4268-cd", "ovs_interfaceid": "f64e4268-cd86-4d6f-a9d5-3aede48c6c5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:05:f5,bridge_name='br-int',has_traffic_filtering=True,id=f64e4268-cd86-4d6f-a9d5-3aede48c6c5c,network=Network(80c98901-f52b-4c61-9065-127a9889eb15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64e4268-cd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG os_vif [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:05:f5,bridge_name='br-int',has_traffic_filtering=True,id=f64e4268-cd86-4d6f-a9d5-3aede48c6c5c,network=Network(80c98901-f52b-4c61-9065-127a9889eb15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64e4268-cd') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf64e4268-cd, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0511d93f-1ec3-4486-81bf-f83098a2b4cb) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:30 user nova-compute[75288]: INFO os_vif [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:05:f5,bridge_name='br-int',has_traffic_filtering=True,id=f64e4268-cd86-4d6f-a9d5-3aede48c6c5c,network=Network(80c98901-f52b-4c61-9065-127a9889eb15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf64e4268-cd')
Nov 10 22:39:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Deleting instance files /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4_del
Nov 10 22:39:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Deletion of /opt/stack/data/nova/instances/5e3770a5-16c7-4b7e-8826-ebd2861085b4_del complete
Nov 10 22:39:30 user nova-compute[75288]: INFO nova.compute.manager [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 10 22:39:30 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:39:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-91df355b-bdfb-46ff-8feb-f2a55ef2c6c9 req-8e0dd2df-9934-4a2a-87fa-021c19d2cc5b service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91df355b-bdfb-46ff-8feb-f2a55ef2c6c9 req-8e0dd2df-9934-4a2a-87fa-021c19d2cc5b service nova] Acquiring lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91df355b-bdfb-46ff-8feb-f2a55ef2c6c9 req-8e0dd2df-9934-4a2a-87fa-021c19d2cc5b service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91df355b-bdfb-46ff-8feb-f2a55ef2c6c9 req-8e0dd2df-9934-4a2a-87fa-021c19d2cc5b service nova] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-91df355b-bdfb-46ff-8feb-f2a55ef2c6c9 req-8e0dd2df-9934-4a2a-87fa-021c19d2cc5b service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] No waiting events found dispatching network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:32 user nova-compute[75288]: WARNING nova.compute.manager [req-91df355b-bdfb-46ff-8feb-f2a55ef2c6c9 req-8e0dd2df-9934-4a2a-87fa-021c19d2cc5b service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received unexpected event network-vif-plugged-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c for instance with vm_state active and task_state deleting.
Nov 10 22:39:32 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:32 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Took 1.80 seconds to deallocate network for instance.
Nov 10 22:39:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:32 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:39:32 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:39:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:32 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Deleted allocations for instance 5e3770a5-16c7-4b7e-8826-ebd2861085b4
Nov 10 22:39:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-93c8d18d-5284-4971-a0bb-55b69458c412 tempest-VolumesAssistedSnapshotsTest-1489622189 tempest-VolumesAssistedSnapshotsTest-1489622189-project-member] Lock "5e3770a5-16c7-4b7e-8826-ebd2861085b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.479s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-2fee40b7-2730-4087-b444-8b44b4c6c3bf req-5792f15b-e163-405f-9b6b-1817eca8a690 service nova] [instance: 5e3770a5-16c7-4b7e-8826-ebd2861085b4] Received event network-vif-deleted-f64e4268-cd86-4d6f-a9d5-3aede48c6c5c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquired lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'info_cache' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.objects.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Releasing lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance destroyed successfully.
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'resources' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.objects.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG os_vif [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa17af079-be, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68eafede-f72d-4f3a-8727-b9aa1d416720) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:40 user nova-compute[75288]: INFO os_vif [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be')
Nov 10 22:39:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJhnapHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:39:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc6cc87-ce0f-4426-86dc-0d45e9353f09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:39:40 user nova-compute[75288]: No targets found.
Nov 10 22:39:40 user nova-compute[75288]: iSNS:
Nov 10 22:39:40 user nova-compute[75288]: No targets found.
Nov 10 22:39:40 user nova-compute[75288]: STATIC:
Nov 10 22:39:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:39:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07
Nov 10 22:39:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:39:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d
Nov 10 22:39:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:39:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:40 user nova-compute[75288]: FIRMWARE:
Nov 10 22:39:40 user nova-compute[75288]: No targets found.
Nov 10 22:39:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:39:40 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:39:40 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:39:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02937dde-1487-4b56-ac44-6c110eb6cc08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85753c65-c637-4477-ad10-aaec89b67f42]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b2b393be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2850349-14de-4697-8f5a-5e714a329a76]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609465b-2a5c-4312-92a7-be45c4abad2b]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[22618789-9e88-48c9-93af-e76ef281c61c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04e371f-b763-4052-bec2-3e9141eb73d0]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bbe61e-d780-4890-aa53-a7eafdb34ca7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5910b0-2395-47ae-86aa-58a2dba52da5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]
Nov 10 22:39:41 user nova-compute[75288]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3331fc-2d1b-4ce1-81e3-96a9f8f4388a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== disconnect_volume: return (374ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Start _get_guest_xml network_info=[{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJhnapHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '33ebbf72-0319-4e06-af0c-cf1462053666', 'attached_at': '', 'detached_at': '', 'volume_id': '089d5b73-557a-4352-abe4-552db2b71a3f', 'serial': '089d5b73-557a-4352-abe4-552db2b71a3f'}, 'mount_device': '/dev/vdb', 'attachment_id': '0d7c52f6-cbb6-4993-a54e-a1e9319b1868', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'numa_topology' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.objects.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.objects.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJhnapHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:39:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:41 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a4c809-9bb0-436a-b279-7796f5169077]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:39:41 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[735a2142-f723-40cd-b54a-86869c5ca447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f] added
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d8f20a-e702-4fee-8f29-4b254d5aa1c6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[968540e0-dc5a-4121-8169-80956a3ceefa]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJhnapHb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJhnapHb" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca566ede-5e62-4221-80eb-4554d9323b31]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJhnapHb'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b0858c-740b-4910-8688-88d37bc5f54a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe3a1bd-434b-4d8a-ad01-beb0dc1ca14b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[49755b95-83cb-45e8-b982-84a4d964f886]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]
Nov 10 22:39:41 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5378d96-ab77-40f6-91b2-b64df0899c09]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c540a0-1e4d-4597-acd5-ad3b88002137]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:41 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca765e-4b69-4b49-aa6f-4239eddef527]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:39:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJhnapHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26637633331373636', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633331373636', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'pci_devices' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG nova.objects.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:39:42 user nova-compute[75288]:   <uuid>33ebbf72-0319-4e06-af0c-cf1462053666</uuid>
Nov 10 22:39:42 user nova-compute[75288]:   <name>instance-00000005</name>
Nov 10 22:39:42 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:39:42 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:39:42 user nova-compute[75288]:   <metadata>
Nov 10 22:39:42 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:39:42 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:39:42 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-1953048792</nova:name>
Nov 10 22:39:42 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:39:41</nova:creationTime>
Nov 10 22:39:42 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:39:42 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:39:42 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:39:42 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:39:42 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:39:42 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:39:42 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:39:42 user nova-compute[75288]:       <nova:owner>
Nov 10 22:39:42 user nova-compute[75288]:         <nova:user uuid="7f6b930fa714405192e875eaf51cff95">tempest-AttachVolumeTestJSON-979908124-project-member</nova:user>
Nov 10 22:39:42 user nova-compute[75288]:         <nova:project uuid="28bbf495a59c4f24945da89346c71dff">tempest-AttachVolumeTestJSON-979908124</nova:project>
Nov 10 22:39:42 user nova-compute[75288]:       </nova:owner>
Nov 10 22:39:42 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:39:42 user nova-compute[75288]:       <nova:ports>
Nov 10 22:39:42 user nova-compute[75288]:         <nova:port uuid="a17af079-be58-40cc-a993-4d5304f20445">
Nov 10 22:39:42 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 22:39:42 user nova-compute[75288]:         </nova:port>
Nov 10 22:39:42 user nova-compute[75288]:       </nova:ports>
Nov 10 22:39:42 user nova-compute[75288]:     </nova:instance>
Nov 10 22:39:42 user nova-compute[75288]:   </metadata>
Nov 10 22:39:42 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:39:42 user nova-compute[75288]:     <system>
Nov 10 22:39:42 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:39:42 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:39:42 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:39:42 user nova-compute[75288]:       <entry name="serial">33ebbf72-0319-4e06-af0c-cf1462053666</entry>
Nov 10 22:39:42 user nova-compute[75288]:       <entry name="uuid">33ebbf72-0319-4e06-af0c-cf1462053666</entry>
Nov 10 22:39:42 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:39:42 user nova-compute[75288]:     </system>
Nov 10 22:39:42 user nova-compute[75288]:   </sysinfo>
Nov 10 22:39:42 user nova-compute[75288]:   <os>
Nov 10 22:39:42 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:39:42 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:39:42 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:39:42 user nova-compute[75288]:   </os>
Nov 10 22:39:42 user nova-compute[75288]:   <features>
Nov 10 22:39:42 user nova-compute[75288]:     <acpi/>
Nov 10 22:39:42 user nova-compute[75288]:     <apic/>
Nov 10 22:39:42 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:39:42 user nova-compute[75288]:   </features>
Nov 10 22:39:42 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:39:42 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:39:42 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:39:42 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:39:42 user nova-compute[75288]:   </clock>
Nov 10 22:39:42 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:39:42 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:39:42 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:39:42 user nova-compute[75288]:   </cpu>
Nov 10 22:39:42 user nova-compute[75288]:   <devices>
Nov 10 22:39:42 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:39:42 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:39:42 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk"/>
Nov 10 22:39:42 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:39:42 user nova-compute[75288]:     </disk>
Nov 10 22:39:42 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:39:42 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:39:42 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Nov 10 22:39:42 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:39:42 user nova-compute[75288]:       <serial>089d5b73-557a-4352-abe4-552db2b71a3f</serial>
Nov 10 22:39:42 user nova-compute[75288]:     </disk>
Nov 10 22:39:42 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:39:42 user nova-compute[75288]:       <mac address="fa:16:3e:36:3b:c0"/>
Nov 10 22:39:42 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:42 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:39:42 user nova-compute[75288]:       <target dev="tapa17af079-be"/>
Nov 10 22:39:42 user nova-compute[75288]:     </interface>
Nov 10 22:39:42 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:39:42 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/console.log" append="off"/>
Nov 10 22:39:42 user nova-compute[75288]:     </serial>
Nov 10 22:39:42 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:39:42 user nova-compute[75288]:     <video>
Nov 10 22:39:42 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:42 user nova-compute[75288]:     </video>
Nov 10 22:39:42 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:39:42 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:39:42 user nova-compute[75288]:     </rng>
Nov 10 22:39:42 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:39:42 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:39:42 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:39:42 user nova-compute[75288]:     </memballoon>
Nov 10 22:39:42 user nova-compute[75288]:   </devices>
Nov 10 22:39:42 user nova-compute[75288]: </domain>
Nov 10 22:39:42 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:39:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-changed-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Refreshing instance network info cache due to event network-changed-833ea9cc-5b3c-45d9-a790-58a325399f50. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] Acquiring lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] Acquired lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.network.neutron [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Refreshing network info cache for port 833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Cannot resize image /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'migration_context' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG os_vif [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd35169cb-7222-504a-b243-b4639ef0aa0e', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa17af079-be, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa17af079-be, col_values=(('qos', UUID('c1ac47c1-c5ff-471a-993f-4b6f90b0d1e4')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa17af079-be, col_values=(('external_ids', {'iface-id': 'a17af079-be58-40cc-a993-4d5304f20445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:3b:c0', 'vm-uuid': '33ebbf72-0319-4e06-af0c-cf1462053666'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:43 user nova-compute[75288]: INFO os_vif [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be')
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG nova.objects.instance [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'flavor' on Instance uuid f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updated VIF entry in instance network info cache for port 833ea9cc-5b3c-45d9-a790-58a325399f50. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updating instance_info_cache with network_info: [{"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ec670a12-cd8a-43e4-913b-bed36f4f0377 req-b9703f61-e6ed-410b-bc8c-54847259730e service nova] Releasing lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:44 user nova-compute[75288]: INFO nova.compute.manager [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Attaching volume 98e750ca-649c-455e-8880-fc1d2804501e to /dev/vdb
Nov 10 22:39:44 user nova-compute[75288]: DEBUG os_brick.utils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eea761-e000-4bbb-b4d6-34f3fad49448]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb2c2ce-4871-4509-b03f-b0c37bf6244a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1753bb5-6c71-48ad-9501-5f809714f4fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f7ebe8-9107-4df0-afbf-90c7d9e7ee28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:39:44 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:39:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[544575fd-540f-4960-9f59-51c94b6ca156]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG os_brick.utils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:39:44 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updating existing volume attachment record: 01313239-f458-4dcf-abaf-563bd9d12063 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-2c53d7e9-5496-4830-90b2-510b390380f2 req-e4f38c7e-701c-4eac-a153-46f8b645fe87 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2c53d7e9-5496-4830-90b2-510b390380f2 req-e4f38c7e-701c-4eac-a153-46f8b645fe87 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2c53d7e9-5496-4830-90b2-510b390380f2 req-e4f38c7e-701c-4eac-a153-46f8b645fe87 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2c53d7e9-5496-4830-90b2-510b390380f2 req-e4f38c7e-701c-4eac-a153-46f8b645fe87 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-2c53d7e9-5496-4830-90b2-510b390380f2 req-e4f38c7e-701c-4eac-a153-46f8b645fe87 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:45 user nova-compute[75288]: WARNING nova.compute.manager [req-2c53d7e9-5496-4830-90b2-510b390380f2 req-e4f38c7e-701c-4eac-a153-46f8b645fe87 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state stopped and task_state powering-on.
Nov 10 22:39:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:39:46 user nova-compute[75288]: INFO nova.compute.claims [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Claim successful on node user
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:39:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:39:46 user nova-compute[75288]: DEBUG nova.policy [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18c5517f32c04ad498f307b9b89c6a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224fa7e9054147d4aa63826efaa17392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:39:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Creating image(s)
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "/opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "/opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Successfully created port: 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk 1073741824" returned: 0 in 0.083s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-3dc17977-bbc2-40f2-9cb7-af8d8db259c9 req-2eafa151-2ac9-4721-8570-793703650325 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3dc17977-bbc2-40f2-9cb7-af8d8db259c9 req-2eafa151-2ac9-4721-8570-793703650325 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3dc17977-bbc2-40f2-9cb7-af8d8db259c9 req-2eafa151-2ac9-4721-8570-793703650325 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3dc17977-bbc2-40f2-9cb7-af8d8db259c9 req-2eafa151-2ac9-4721-8570-793703650325 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-3dc17977-bbc2-40f2-9cb7-af8d8db259c9 req-2eafa151-2ac9-4721-8570-793703650325 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:47 user nova-compute[75288]: WARNING nova.compute.manager [req-3dc17977-bbc2-40f2-9cb7-af8d8db259c9 req-2eafa151-2ac9-4721-8570-793703650325 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state stopped and task_state powering-on.
Nov 10 22:39:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:39:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance rebooted successfully.
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3b7d1416-92ab-4e0e-a702-f1fbd32f1840 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Cannot resize image /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Ensure instance console log exists: /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Successfully updated port: 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance network_info: |[{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Start _get_guest_xml network_info=[{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:39:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1763701259',display_name='tempest-ServerActionsTestOtherB-server-1763701259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1763701259',id=16,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuF/yviImHglYGIXiLmfbAvxX1/9/n49hx51CEU4vPIIK0cwYCFjIHSOmrYvu7mdk8fQPm8oJwZeKNCXTTt3FJg6Tq2wup2YgajWX6dwhMXP1Xwfv2hMNZnvwgRC226mA==',key_name='tempest-keypair-37753185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='224fa7e9054147d4aa63826efaa17392',ramdisk_id='',reservation_id='r-hxndv4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-594854393',owner_user_name='tempest-ServerActionsTestOtherB-594854393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c5517f32c04ad498f307b9b89c6a45',uuid=b9342997-048d-4f4f-a552-de76f2a0a444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converting VIF {"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lazy-loading 'pci_devices' on Instance uuid b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:39:48 user nova-compute[75288]:   <uuid>b9342997-048d-4f4f-a552-de76f2a0a444</uuid>
Nov 10 22:39:48 user nova-compute[75288]:   <name>instance-00000010</name>
Nov 10 22:39:48 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:39:48 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:39:48 user nova-compute[75288]:   <metadata>
Nov 10 22:39:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:39:48 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:39:48 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherB-server-1763701259</nova:name>
Nov 10 22:39:48 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:39:48</nova:creationTime>
Nov 10 22:39:48 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:39:48 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:39:48 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:39:48 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:39:48 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:39:48 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:39:48 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:39:48 user nova-compute[75288]:       <nova:owner>
Nov 10 22:39:48 user nova-compute[75288]:         <nova:user uuid="18c5517f32c04ad498f307b9b89c6a45">tempest-ServerActionsTestOtherB-594854393-project-member</nova:user>
Nov 10 22:39:48 user nova-compute[75288]:         <nova:project uuid="224fa7e9054147d4aa63826efaa17392">tempest-ServerActionsTestOtherB-594854393</nova:project>
Nov 10 22:39:48 user nova-compute[75288]:       </nova:owner>
Nov 10 22:39:48 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:39:48 user nova-compute[75288]:       <nova:ports>
Nov 10 22:39:48 user nova-compute[75288]:         <nova:port uuid="909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83">
Nov 10 22:39:48 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 22:39:48 user nova-compute[75288]:         </nova:port>
Nov 10 22:39:48 user nova-compute[75288]:       </nova:ports>
Nov 10 22:39:48 user nova-compute[75288]:     </nova:instance>
Nov 10 22:39:48 user nova-compute[75288]:   </metadata>
Nov 10 22:39:48 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:39:48 user nova-compute[75288]:     <system>
Nov 10 22:39:48 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:39:48 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:39:48 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:39:48 user nova-compute[75288]:       <entry name="serial">b9342997-048d-4f4f-a552-de76f2a0a444</entry>
Nov 10 22:39:48 user nova-compute[75288]:       <entry name="uuid">b9342997-048d-4f4f-a552-de76f2a0a444</entry>
Nov 10 22:39:48 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:39:48 user nova-compute[75288]:     </system>
Nov 10 22:39:48 user nova-compute[75288]:   </sysinfo>
Nov 10 22:39:48 user nova-compute[75288]:   <os>
Nov 10 22:39:48 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:39:48 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:39:48 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:39:48 user nova-compute[75288]:   </os>
Nov 10 22:39:48 user nova-compute[75288]:   <features>
Nov 10 22:39:48 user nova-compute[75288]:     <acpi/>
Nov 10 22:39:48 user nova-compute[75288]:     <apic/>
Nov 10 22:39:48 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:39:48 user nova-compute[75288]:   </features>
Nov 10 22:39:48 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:39:48 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:39:48 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:39:48 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:39:48 user nova-compute[75288]:   </clock>
Nov 10 22:39:48 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:39:48 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:39:48 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:39:48 user nova-compute[75288]:   </cpu>
Nov 10 22:39:48 user nova-compute[75288]:   <devices>
Nov 10 22:39:48 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:39:48 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:39:48 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk"/>
Nov 10 22:39:48 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:39:48 user nova-compute[75288]:     </disk>
Nov 10 22:39:48 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:39:48 user nova-compute[75288]:       <mac address="fa:16:3e:4f:a7:85"/>
Nov 10 22:39:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:48 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:39:48 user nova-compute[75288]:       <target dev="tap909c66a6-f3"/>
Nov 10 22:39:48 user nova-compute[75288]:     </interface>
Nov 10 22:39:48 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:39:48 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/console.log" append="off"/>
Nov 10 22:39:48 user nova-compute[75288]:     </serial>
Nov 10 22:39:48 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:39:48 user nova-compute[75288]:     <video>
Nov 10 22:39:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:39:48 user nova-compute[75288]:     </video>
Nov 10 22:39:48 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:39:48 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:39:48 user nova-compute[75288]:     </rng>
Nov 10 22:39:48 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:39:48 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:39:48 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:39:48 user nova-compute[75288]:     </memballoon>
Nov 10 22:39:48 user nova-compute[75288]:   </devices>
Nov 10 22:39:48 user nova-compute[75288]: </domain>
Nov 10 22:39:48 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1763701259',display_name='tempest-ServerActionsTestOtherB-server-1763701259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1763701259',id=16,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuF/yviImHglYGIXiLmfbAvxX1/9/n49hx51CEU4vPIIK0cwYCFjIHSOmrYvu7mdk8fQPm8oJwZeKNCXTTt3FJg6Tq2wup2YgajWX6dwhMXP1Xwfv2hMNZnvwgRC226mA==',key_name='tempest-keypair-37753185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='224fa7e9054147d4aa63826efaa17392',ramdisk_id='',reservation_id='r-hxndv4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-594854393',owner_user_name='tempest-ServerActionsTestOtherB-594854393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c5517f32c04ad498f307b9b89c6a45',uuid=b9342997-048d-4f4f-a552-de76f2a0a444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converting VIF {"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG os_vif [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27cf2bca-cd1e-522f-bd5e-ecfb9676e2a2', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap909c66a6-f3, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap909c66a6-f3, col_values=(('qos', UUID('bccfd2f6-83ea-41ec-916d-93ce187abe9d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap909c66a6-f3, col_values=(('external_ids', {'iface-id': '909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:a7:85', 'vm-uuid': 'b9342997-048d-4f4f-a552-de76f2a0a444'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:48 user nova-compute[75288]: INFO os_vif [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3')
Nov 10 22:39:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:39:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No VIF found with MAC fa:16:3e:4f:a7:85, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:39:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-changed-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Refreshing instance network info cache due to event network-changed-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:39:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Refreshing network info cache for port 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:39:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updated VIF entry in instance network info cache for port 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:39:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb9dbb7c-8c24-4716-93ca-9a12e8ac836f req-c494f126-b4df-4e8f-bde7-ef4aeecfa1e3 service nova] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-c5db3cc7-b64d-47cc-a23e-a66ccd59fd19 req-b3bf946c-00ed-4220-b0d9-8a6c5f88a317 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5db3cc7-b64d-47cc-a23e-a66ccd59fd19 req-b3bf946c-00ed-4220-b0d9-8a6c5f88a317 service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5db3cc7-b64d-47cc-a23e-a66ccd59fd19 req-b3bf946c-00ed-4220-b0d9-8a6c5f88a317 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5db3cc7-b64d-47cc-a23e-a66ccd59fd19 req-b3bf946c-00ed-4220-b0d9-8a6c5f88a317 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-c5db3cc7-b64d-47cc-a23e-a66ccd59fd19 req-b3bf946c-00ed-4220-b0d9-8a6c5f88a317 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:51 user nova-compute[75288]: WARNING nova.compute.manager [req-c5db3cc7-b64d-47cc-a23e-a66ccd59fd19 req-b3bf946c-00ed-4220-b0d9-8a6c5f88a317 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state building and task_state spawning.
Nov 10 22:39:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-changed-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing instance network info cache due to event network-changed-dc7936a1-6060-4ea8-bc0a-d03a995b2902. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] Acquiring lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] Acquired lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:39:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Refreshing network info cache for port dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:39:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updated VIF entry in instance network info cache for port dc7936a1-6060-4ea8-bc0a-d03a995b2902. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:39:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [{"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:39:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6784924a-8299-401a-ad3b-358e16ae5cf1 req-7f49a319-07aa-498b-9d1d-2b6b346f879b service nova] Releasing lock "refresh_cache-7e41f40b-859f-4239-b5e5-a787af7e28ad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-ad16fd53-9df3-4dbe-80cd-432388525faf req-c11b0e96-434d-4c85-ad77-19c60e149501 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ad16fd53-9df3-4dbe-80cd-432388525faf req-c11b0e96-434d-4c85-ad77-19c60e149501 service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ad16fd53-9df3-4dbe-80cd-432388525faf req-c11b0e96-434d-4c85-ad77-19c60e149501 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ad16fd53-9df3-4dbe-80cd-432388525faf req-c11b0e96-434d-4c85-ad77-19c60e149501 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-ad16fd53-9df3-4dbe-80cd-432388525faf req-c11b0e96-434d-4c85-ad77-19c60e149501 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:53 user nova-compute[75288]: WARNING nova.compute.manager [req-ad16fd53-9df3-4dbe-80cd-432388525faf req-c11b0e96-434d-4c85-ad77-19c60e149501 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state building and task_state spawning.
Nov 10 22:39:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:39:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance spawned successfully.
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:39:53 user nova-compute[75288]: INFO nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 10 22:39:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:39:53 user nova-compute[75288]: INFO nova.compute.manager [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Took 7.59 seconds to build instance.
Nov 10 22:39:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9cff1d2-9355-4e32-b199-23571f632034 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.717s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:54 user nova-compute[75288]: INFO nova.compute.manager [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Terminating instance
Nov 10 22:39:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-11f21570-5802-4671-9a42-9f331ae1640d req-1f5e13a9-cb8d-4d7b-ad2f-74460e032574 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-11f21570-5802-4671-9a42-9f331ae1640d req-1f5e13a9-cb8d-4d7b-ad2f-74460e032574 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-11f21570-5802-4671-9a42-9f331ae1640d req-1f5e13a9-cb8d-4d7b-ad2f-74460e032574 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-11f21570-5802-4671-9a42-9f331ae1640d req-1f5e13a9-cb8d-4d7b-ad2f-74460e032574 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-11f21570-5802-4671-9a42-9f331ae1640d req-1f5e13a9-cb8d-4d7b-ad2f-74460e032574 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-unplugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-11f21570-5802-4671-9a42-9f331ae1640d req-1f5e13a9-cb8d-4d7b-ad2f-74460e032574 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-679f1425-ffeb-443e-8973-1d8e39024fae req-c42f3975-60f5-495d-a29d-953bc4c948bc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-679f1425-ffeb-443e-8973-1d8e39024fae req-c42f3975-60f5-495d-a29d-953bc4c948bc service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-679f1425-ffeb-443e-8973-1d8e39024fae req-c42f3975-60f5-495d-a29d-953bc4c948bc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-679f1425-ffeb-443e-8973-1d8e39024fae req-c42f3975-60f5-495d-a29d-953bc4c948bc service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-679f1425-ffeb-443e-8973-1d8e39024fae req-c42f3975-60f5-495d-a29d-953bc4c948bc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-unplugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-679f1425-ffeb-443e-8973-1d8e39024fae req-c42f3975-60f5-495d-a29d-953bc4c948bc service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-3194e488-3ce5-4b14-b7f7-c4fe522a511c req-f529a1f8-7d8f-4a2c-9c1d-4a8da0e87b82 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3194e488-3ce5-4b14-b7f7-c4fe522a511c req-f529a1f8-7d8f-4a2c-9c1d-4a8da0e87b82 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3194e488-3ce5-4b14-b7f7-c4fe522a511c req-f529a1f8-7d8f-4a2c-9c1d-4a8da0e87b82 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3194e488-3ce5-4b14-b7f7-c4fe522a511c req-f529a1f8-7d8f-4a2c-9c1d-4a8da0e87b82 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-3194e488-3ce5-4b14-b7f7-c4fe522a511c req-f529a1f8-7d8f-4a2c-9c1d-4a8da0e87b82 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-unplugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-3194e488-3ce5-4b14-b7f7-c4fe522a511c req-f529a1f8-7d8f-4a2c-9c1d-4a8da0e87b82 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-7bf243a0-ae7b-49c7-a602-680b5621df79 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Instance destroyed successfully.
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lazy-loading 'resources' on Instance uuid 7e41f40b-859f-4239-b5e5-a787af7e28ad {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "address": "fa:16:3e:a7:78:af", "network": {"id": "f2113043-a019-4638-9677-3436e37f4634", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-205620919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7936a1-60", "ovs_interfaceid": "dc7936a1-6060-4ea8-bc0a-d03a995b2902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:78:af,bridge_name='br-int',has_traffic_filtering=True,id=dc7936a1-6060-4ea8-bc0a-d03a995b2902,network=Network(f2113043-a019-4638-9677-3436e37f4634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7936a1-60') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:78:af,bridge_name='br-int',has_traffic_filtering=True,id=dc7936a1-6060-4ea8-bc0a-d03a995b2902,network=Network(f2113043-a019-4638-9677-3436e37f4634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7936a1-60') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc7936a1-60, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40fe8b56-eac0-4db2-97fa-c04669baffe1) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:78:af,bridge_name='br-int',has_traffic_filtering=True,id=dc7936a1-6060-4ea8-bc0a-d03a995b2902,network=Network(f2113043-a019-4638-9677-3436e37f4634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7936a1-60')
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:01:17,bridge_name='br-int',has_traffic_filtering=True,id=bcebe502-3e3e-486a-a332-f3679a175811,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcebe502-3e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:01:17,bridge_name='br-int',has_traffic_filtering=True,id=bcebe502-3e3e-486a-a332-f3679a175811,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcebe502-3e') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcebe502-3e, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd13c69e-2acc-49bc-834b-ec2674bd00f0) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:01:17,bridge_name='br-int',has_traffic_filtering=True,id=bcebe502-3e3e-486a-a332-f3679a175811,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbcebe502-3e')
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ad:36,bridge_name='br-int',has_traffic_filtering=True,id=f198f762-e7ad-4362-85ad-735538cf8b1c,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf198f762-e7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ad:36,bridge_name='br-int',has_traffic_filtering=True,id=f198f762-e7ad-4362-85ad-735538cf8b1c,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf198f762-e7') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf198f762-e7, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f111d446-ba7a-498b-80ba-28f007d93a29) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ad:36,bridge_name='br-int',has_traffic_filtering=True,id=f198f762-e7ad-4362-85ad-735538cf8b1c,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf198f762-e7')
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:36:19,bridge_name='br-int',has_traffic_filtering=True,id=3aa2573a-fa2d-4ca9-adc1-36c5b17b7785,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aa2573a-fa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:36:19,bridge_name='br-int',has_traffic_filtering=True,id=3aa2573a-fa2d-4ca9-adc1-36c5b17b7785,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aa2573a-fa') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3aa2573a-fa, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: WARNING nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-dc7936a1-6060-4ea8-bc0a-d03a995b2902 for instance with vm_state active and task_state deleting.
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-unplugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-bcebe502-3e3e-486a-a332-f3679a175811 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: WARNING nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-bcebe502-3e3e-486a-a332-f3679a175811 for instance with vm_state active and task_state deleting.
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-unplugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-f198f762-e7ad-4362-85ad-735538cf8b1c for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: WARNING nova.compute.manager [req-37642d12-a855-493f-9e27-aa84fe06aff8 req-c854f5ff-2c11-433c-9b2a-b94e000837b2 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-f198f762-e7ad-4362-85ad-735538cf8b1c for instance with vm_state active and task_state deleting.
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ea181fb-e17a-4187-93ab-df03349df373) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:36:19,bridge_name='br-int',has_traffic_filtering=True,id=3aa2573a-fa2d-4ca9-adc1-36c5b17b7785,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aa2573a-fa')
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:51,bridge_name='br-int',has_traffic_filtering=True,id=5acd3810-8cbd-425f-af05-8e33cdfa9e5a,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acd3810-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:51,bridge_name='br-int',has_traffic_filtering=True,id=5acd3810-8cbd-425f-af05-8e33cdfa9e5a,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acd3810-8c') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5acd3810-8c, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49f76a5e-f2d2-4670-8a93-be527a30b24c) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:51,bridge_name='br-int',has_traffic_filtering=True,id=5acd3810-8cbd-425f-af05-8e33cdfa9e5a,network=Network(fbce673d-4f35-4e86-88cf-fba1a65d8dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5acd3810-8c')
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:a7,bridge_name='br-int',has_traffic_filtering=True,id=7bf243a0-ae7b-49c7-a602-680b5621df79,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf243a0-ae') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:a7,bridge_name='br-int',has_traffic_filtering=True,id=7bf243a0-ae7b-49c7-a602-680b5621df79,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf243a0-ae') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bf243a0-ae, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b009439-eea2-410c-8294-65b09c90271e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:a7,bridge_name='br-int',has_traffic_filtering=True,id=7bf243a0-ae7b-49c7-a602-680b5621df79,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf243a0-ae')
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T22:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-846737018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-846737018',id=10,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+EjzaG02GzrSwhl54WRSH7kOPkYvG5rKFHorHP0hnwThisifH72OfUehqbaSxXbLTxAzJB16fJh6gUsghqjVyFJx2Xua/ap73Xoil/am7j+fy5DBwjdf6ds9jkdHH7CA==',key_name='tempest-keypair-178492208',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d9c346e8b64225b46aff84560ee0f2',ramdisk_id='',reservation_id='r-oh9mcird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-793515078',owner_user_name='tempest-TaggedBootDevicesTest-793515078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09aff48c3ed14ceda87ced776db66878',uuid=7e41f40b-859f-4239-b5e5-a787af7e28ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converting VIF {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e3:de,bridge_name='br-int',has_traffic_filtering=True,id=371a03ef-3889-464c-a07a-7a9e5e30ddd5,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371a03ef-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e3:de,bridge_name='br-int',has_traffic_filtering=True,id=371a03ef-3889-464c-a07a-7a9e5e30ddd5,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371a03ef-38') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap371a03ef-38, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec98a81d-2f17-45fd-8a53-e05d822a5618) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:57 user nova-compute[75288]: INFO os_vif [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e3:de,bridge_name='br-int',has_traffic_filtering=True,id=371a03ef-3889-464c-a07a-7a9e5e30ddd5,network=Network(13bbfec1-54f6-41cf-9856-2ce964833008),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371a03ef-38')
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxdZEFVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:39:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: WARNING nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 for instance with vm_state active and task_state deleting.
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-unplugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:57 user nova-compute[75288]: WARNING nova.compute.manager [req-916ca99a-22fb-47f7-a3e2-223959f0c609 req-5a06008f-cbd2-4c6f-97af-7a5d11eefb2b service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-5acd3810-8cbd-425f-af05-8e33cdfa9e5a for instance with vm_state active and task_state deleting.
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7864c03-12cb-4c17-ba6c-9f298b52ec34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:39:57 user nova-compute[75288]: No targets found.
Nov 10 22:39:57 user nova-compute[75288]: iSNS:
Nov 10 22:39:57 user nova-compute[75288]: No targets found.
Nov 10 22:39:57 user nova-compute[75288]: STATIC:
Nov 10 22:39:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:39:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:57 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07
Nov 10 22:39:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:57 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:39:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:57 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d
Nov 10 22:39:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:57 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:39:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:57 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:57 user nova-compute[75288]: FIRMWARE:
Nov 10 22:39:57 user nova-compute[75288]: No targets found.
Nov 10 22:39:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:39:57 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:39:57 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddbe18b-70bb-46bf-97a1-1d181e425817]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93c84b-fd39-49c0-8025-1590aef64a02]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b104e3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc221f60-fc9e-42b9-9101-6f6417517691]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32381a5-5ed1-45e7-b344-433ed87d2ade]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[96247782-dc35-4aed-bbf7-534f9b7a621c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3b6e5b-e121-40af-9a11-7f8a0e87ad28]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:58 user nova-compute[75288]: WARNING nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-7bf243a0-ae7b-49c7-a602-680b5621df79 for instance with vm_state active and task_state deleting.
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-unplugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-unplugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Acquiring lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] No waiting events found dispatching network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:39:58 user nova-compute[75288]: WARNING nova.compute.manager [req-77c0ba16-7fab-4081-b169-cd3806284926 req-2676320f-1d55-47ef-924f-c120326d2089 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received unexpected event network-vif-plugged-371a03ef-3889-464c-a07a-7a9e5e30ddd5 for instance with vm_state active and task_state deleting.
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[15238775-153c-4916-b246-c0f590b721f4]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1b0d2-ab32-4499-984c-8581790f8c91]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260]
Nov 10 22:39:58 user nova-compute[75288]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07, portal: 172.16.0.220,3260] successful.
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a82c99-40d3-48ed-a341-dda7d1603f07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc6c0e-1752-4b47-8f6b-f6418115ea0d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== disconnect_volume: return (439ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHLilNVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:39:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a422fa-6656-4737-9489-6764797819d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:39:58 user nova-compute[75288]: No targets found.
Nov 10 22:39:58 user nova-compute[75288]: iSNS:
Nov 10 22:39:58 user nova-compute[75288]: No targets found.
Nov 10 22:39:58 user nova-compute[75288]: STATIC:
Nov 10 22:39:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:39:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:39:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d
Nov 10 22:39:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:39:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:58 user nova-compute[75288]: FIRMWARE:
Nov 10 22:39:58 user nova-compute[75288]: No targets found.
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:39:58 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:39:58 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c76e118-fd9b-41fd-b4f1-f51b3982a3a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbbe79b-938f-4c8e-9e47-edc03d4fe642]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10355f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d'): ({'sdf'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Removing single pathed devices sdf {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb87e03-478c-4b04-94eb-fc50f005291e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d66762-cdb8-4dfc-b1b0-71a7444a2420]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Flushing IO for device /dev/sdf {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3019fa-441c-40a8-a0f7-b4fafef3e6d3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daa193d-d593-4755-ac8f-b1b0f0c2b8f8]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab30227-ba1c-490a-8018-dd1a35306b5d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704aca3-3795-4d64-8a8d-04dda9e4b1df]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260]
Nov 10 22:39:58 user nova-compute[75288]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d, portal: 172.16.0.220,3260] successful.
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8af8288-08e0-4e1c-aa78-9621d9222e7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f948d7a-ebf5-4239-9faf-2d434d53830e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== disconnect_volume: return (423ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvfxVIka', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:39:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e29b2f-1ff8-4834-9cf3-e428289307fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:39:58 user nova-compute[75288]: No targets found.
Nov 10 22:39:58 user nova-compute[75288]: iSNS:
Nov 10 22:39:58 user nova-compute[75288]: No targets found.
Nov 10 22:39:58 user nova-compute[75288]: STATIC:
Nov 10 22:39:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706
Nov 10 22:39:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:39:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:39:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:39:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:39:58 user nova-compute[75288]: FIRMWARE:
Nov 10 22:39:58 user nova-compute[75288]: No targets found.
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:39:58 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:39:58 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a9c2c-a2ce-46b7-a37a-c20de2c9d46d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ffac58-ec19-472c-b964-e6e322dd10bc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:39:58 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 (non-flash)
Nov 10 22:39:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10355f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706'): ({'sdg'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Removing single pathed devices sdg {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de1e9d0-ba17-4455-b44b-84d0a1dacc46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f8ca6-a410-4df0-b384-3ba8234017a6]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Flushing IO for device /dev/sdg {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[382d2901-32bc-40ca-a28c-981c7292a9be]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a7cc76-3f05-43f0-95bb-39ccb89ba78b]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] SCSI volumes sdg have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:39:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[626f081b-34ba-4cb2-a231-fb56720cb14e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d794d2b-a0b1-4ebf-af4f-1e4860e81cbd]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260]
Nov 10 22:39:59 user nova-compute[75288]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706, portal: 172.16.0.220,3260] successful.
Nov 10 22:39:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f2c87c-0dc1-4d0a-bfb2-ba6658317706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1558eb5-7634-4017-aae2-db46f700f547]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] <== disconnect_volume: return (359ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:39:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Deleting instance files /opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad_del
Nov 10 22:39:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Deletion of /opt/stack/data/nova/instances/7e41f40b-859f-4239-b5e5-a787af7e28ad_del complete
Nov 10 22:39:59 user nova-compute[75288]: INFO nova.compute.manager [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Took 4.21 seconds to destroy the instance on the hypervisor.
Nov 10 22:39:59 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:39:59 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:40:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-cba74c47-6044-46fa-b795-9d79f8c8e626 req-96e570ee-94e6-4891-ab6b-224e3ac5dc39 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-deleted-dc7936a1-6060-4ea8-bc0a-d03a995b2902 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:02 user nova-compute[75288]: INFO nova.compute.manager [req-cba74c47-6044-46fa-b795-9d79f8c8e626 req-96e570ee-94e6-4891-ab6b-224e3ac5dc39 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Neutron deleted interface dc7936a1-6060-4ea8-bc0a-d03a995b2902; detaching it from the instance and deleting it from the info cache
Nov 10 22:40:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-cba74c47-6044-46fa-b795-9d79f8c8e626 req-96e570ee-94e6-4891-ab6b-224e3ac5dc39 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [{"id": "bcebe502-3e3e-486a-a332-f3679a175811", "address": "fa:16:3e:f4:01:17", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcebe502-3e", "ovs_interfaceid": "bcebe502-3e3e-486a-a332-f3679a175811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f198f762-e7ad-4362-85ad-735538cf8b1c", "address": "fa:16:3e:60:ad:36", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf198f762-e7", "ovs_interfaceid": "f198f762-e7ad-4362-85ad-735538cf8b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "address": "fa:16:3e:9f:36:19", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aa2573a-fa", "ovs_interfaceid": "3aa2573a-fa2d-4ca9-adc1-36c5b17b7785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "address": "fa:16:3e:6f:b8:51", "network": {"id": "fbce673d-4f35-4e86-88cf-fba1a65d8dcd", "bridge": "br-int", "label": "tempest-device-tagging-net1-866419739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5acd3810-8c", "ovs_interfaceid": "5acd3810-8cbd-425f-af05-8e33cdfa9e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7bf243a0-ae7b-49c7-a602-680b5621df79", "address": "fa:16:3e:fb:20:a7", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf243a0-ae", "ovs_interfaceid": "7bf243a0-ae7b-49c7-a602-680b5621df79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "address": "fa:16:3e:ae:e3:de", "network": {"id": "13bbfec1-54f6-41cf-9856-2ce964833008", "bridge": "br-int", "label": "tempest-device-tagging-net2-773471887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36d9c346e8b64225b46aff84560ee0f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371a03ef-38", "ovs_interfaceid": "371a03ef-3889-464c-a07a-7a9e5e30ddd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:40:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-cba74c47-6044-46fa-b795-9d79f8c8e626 req-96e570ee-94e6-4891-ab6b-224e3ac5dc39 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Detach interface failed, port_id=dc7936a1-6060-4ea8-bc0a-d03a995b2902, reason: Instance 7e41f40b-859f-4239-b5e5-a787af7e28ad could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:40:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:03 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:40:03 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Took 4.26 seconds to deallocate network for instance.
Nov 10 22:40:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-2cedcbf8-e70c-4670-bd1a-88bd81bf1625 req-bf4c0b9c-a0ea-43f0-af4b-1278e7797387 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-deleted-3aa2573a-fa2d-4ca9-adc1-36c5b17b7785 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-2cedcbf8-e70c-4670-bd1a-88bd81bf1625 req-bf4c0b9c-a0ea-43f0-af4b-1278e7797387 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-deleted-371a03ef-3889-464c-a07a-7a9e5e30ddd5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-2cedcbf8-e70c-4670-bd1a-88bd81bf1625 req-bf4c0b9c-a0ea-43f0-af4b-1278e7797387 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-deleted-5acd3810-8cbd-425f-af05-8e33cdfa9e5a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-2cedcbf8-e70c-4670-bd1a-88bd81bf1625 req-bf4c0b9c-a0ea-43f0-af4b-1278e7797387 service nova] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Received event network-vif-deleted-7bf243a0-ae7b-49c7-a602-680b5621df79 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:06 user nova-compute[75288]: INFO nova.compute.manager [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] [instance: 7e41f40b-859f-4239-b5e5-a787af7e28ad] Took 3.23 seconds to detach 3 volumes for instance.
Nov 10 22:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:07 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:40:07 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:40:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:07 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Deleted allocations for instance 7e41f40b-859f-4239-b5e5-a787af7e28ad
Nov 10 22:40:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-68bfaffb-cf0b-4561-922c-e1800bd7e981 tempest-TaggedBootDevicesTest-793515078 tempest-TaggedBootDevicesTest-793515078-project-member] Lock "7e41f40b-859f-4239-b5e5-a787af7e28ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.335s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:40:14 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:40:14 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:40:14 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[361a0781-6052-4fd8-85f2-e2fac2596c70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:40:14 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3245ff28-b055-4e23-964e-204fa6e5c4c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e] added
Nov 10 22:40:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2785a9a-65c9-4e28-b800-490836e9bad7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: INFO nova.compute.manager [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Detaching volume 81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db59159-09b0-455c-95c9-a1430043d624]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilnGPsVK {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilnGPsVK" returned: 0 in 0.032s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeba3a6-9492-480b-a5bc-5f44e67283db]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ilnGPsVK'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: INFO nova.virt.block_device [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Attempting to driver detach volume 81e85fec-9286-49b5-81a2-ff2bdc4fe547 from mountpoint /dev/vdc
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e660b5-53c8-49ba-9aa0-6e294be35fad]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Attempting to detach device vdc from instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:40:14 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:40:14 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:40:14 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:40:14 user nova-compute[75288]:   <serial>81e85fec-9286-49b5-81a2-ff2bdc4fe547</serial>
Nov 10 22:40:14 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:40:14 user nova-compute[75288]: </disk>
Nov 10 22:40:14 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[675c30e2-68ef-4b79-b2bd-7b802b428d73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:14 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:14 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:40:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully detached device vdc from instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 from the persistent domain config.
Nov 10 22:40:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:40:14 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:40:14 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:40:14 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:40:14 user nova-compute[75288]:   <serial>81e85fec-9286-49b5-81a2-ff2bdc4fe547</serial>
Nov 10 22:40:14 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:40:14 user nova-compute[75288]: </disk>
Nov 10 22:40:14 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acbeb81-76a1-4ce6-b5cd-344057264a32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]
Nov 10 22:40:14 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.
Nov 10 22:40:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[80206cea-2174-4abb-815d-c02c1fffe778]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.157s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e203a024-075b-4067-82c6-3e74b0cfd589]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:15 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:15 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:40:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:15 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:15 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:40:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.453s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.111s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbb3919-b3e3-40b3-8728-9914c8e09b07]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.578s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== connect_volume: return (1580ms) {'type': 'block', 'scsi_wwn': '23135346363316665', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135346363316665', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG nova.objects.instance [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'flavor' on Instance uuid f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:40:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:40:15 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:40:15 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:40:15 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:40:15 user nova-compute[75288]:   <serial>98e750ca-649c-455e-8880-fc1d2804501e</serial>
Nov 10 22:40:15 user nova-compute[75288]: </disk>
Nov 10 22:40:15 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:40:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:40:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:40:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No VIF found with MAC fa:16:3e:ef:ad:c3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:40:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-06f874a4-79ef-45df-a533-2ccd2c2799af tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.852s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:18 user nova-compute[75288]: INFO nova.compute.manager [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Rebuilding instance
Nov 10 22:40:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d63aa1ff-4682-46e6-a028-424a90d33e33 req-076cdcda-74a7-485c-8a8d-81f960ca62da service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-unplugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d63aa1ff-4682-46e6-a028-424a90d33e33 req-076cdcda-74a7-485c-8a8d-81f960ca62da service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d63aa1ff-4682-46e6-a028-424a90d33e33 req-076cdcda-74a7-485c-8a8d-81f960ca62da service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d63aa1ff-4682-46e6-a028-424a90d33e33 req-076cdcda-74a7-485c-8a8d-81f960ca62da service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d63aa1ff-4682-46e6-a028-424a90d33e33 req-076cdcda-74a7-485c-8a8d-81f960ca62da service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-unplugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:40:18 user nova-compute[75288]: WARNING nova.compute.manager [req-d63aa1ff-4682-46e6-a028-424a90d33e33 req-076cdcda-74a7-485c-8a8d-81f960ca62da service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received unexpected event network-vif-unplugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with vm_state active and task_state rebuilding.
Nov 10 22:40:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance destroyed successfully.
Nov 10 22:40:19 user nova-compute[75288]: INFO nova.compute.manager [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Detaching volume 98e750ca-649c-455e-8880-fc1d2804501e
Nov 10 22:40:19 user nova-compute[75288]: INFO nova.virt.block_device [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Attempting to driver detach volume 98e750ca-649c-455e-8880-fc1d2804501e from mountpoint /dev/vdb
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Attempting to detach device vdb from instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:40:19 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:40:19 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:40:19 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:40:19 user nova-compute[75288]:   <serial>98e750ca-649c-455e-8880-fc1d2804501e</serial>
Nov 10 22:40:19 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:40:19 user nova-compute[75288]: </disk>
Nov 10 22:40:19 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:40:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully detached device vdb from instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf from the persistent domain config.
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:40:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3375b55-77c2-403a-9b7e-51799ee0df0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:40:19 user nova-compute[75288]: No targets found.
Nov 10 22:40:19 user nova-compute[75288]: iSNS:
Nov 10 22:40:19 user nova-compute[75288]: No targets found.
Nov 10 22:40:19 user nova-compute[75288]: STATIC:
Nov 10 22:40:19 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:40:19 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:40:19 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:40:19 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e
Nov 10 22:40:19 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:40:19 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:40:19 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:40:19 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:40:19 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:40:19 user nova-compute[75288]: FIRMWARE:
Nov 10 22:40:19 user nova-compute[75288]: No targets found.
Nov 10 22:40:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:40:19 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:40:19 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e276352-1eee-4cf7-a201-f2981d528251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef3edbc-1037-4ad8-ab9b-7d37d79a4dac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:19 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:19 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:40:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:19 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:19 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:40:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b28149510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2da88b-3532-4014-be77-d3d27a8ab536]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eee9f9-5ebc-403e-acc5-634dc60c1564]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d733c669-c33c-470e-9884-756b4a7211dc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c250c89-b36f-4ee2-9167-c016b37857e9]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc5aba-f33a-4e91-9a57-2b808f951414]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7500af52-8549-4e70-8b54-775a7cde0ff4]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]
Nov 10 22:40:19 user nova-compute[75288]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.
Nov 10 22:40:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aed023-50ba-4655-930e-7b5021af9209]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== disconnect_volume: return (302ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:40:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 032de95e-98a7-411d-8726-5bf3a5c0ca49 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updating instance_info_cache with network_info: [{"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-0376e299-569f-4642-aa08-552e9e433ff1 req-7d018395-9e57-4e00-832e-f4fd382b16d8 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0376e299-569f-4642-aa08-552e9e433ff1 req-7d018395-9e57-4e00-832e-f4fd382b16d8 service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0376e299-569f-4642-aa08-552e9e433ff1 req-7d018395-9e57-4e00-832e-f4fd382b16d8 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0376e299-569f-4642-aa08-552e9e433ff1 req-7d018395-9e57-4e00-832e-f4fd382b16d8 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-0376e299-569f-4642-aa08-552e9e433ff1 req-7d018395-9e57-4e00-832e-f4fd382b16d8 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:40:20 user nova-compute[75288]: WARNING nova.compute.manager [req-0376e299-569f-4642-aa08-552e9e433ff1 req-7d018395-9e57-4e00-832e-f4fd382b16d8 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received unexpected event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with vm_state active and task_state rebuilding.
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance destroyed successfully.
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-787401219',display_name='tempest-ServerActionsTestOtherA-server-706973279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-787401219',id=12,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgur9VwcRgcPAddQ2yq2SDKWwkCHOc79qk3MMstyvI4JbzUO7We++xhPD+OI0zsJ8ZIjY2xd7tJ3cZf88cGEqNEfrxS53zEnlcJXT2NxUBnilmBfl9N4p955pTEXCQ+jg==',key_name='tempest-keypair-1131382431',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:37:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-i8dgfs40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:40:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=f9c056b7-56a6-4dd9-972b-7290c27c8fcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG os_vif [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap833ea9cc-5b, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0452d022-9664-4a1e-8b82-f4366a49ef7a) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:40:20 user nova-compute[75288]: INFO os_vif [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b')
Nov 10 22:40:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:40:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:40:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbc5498-fad8-47ea-a01b-0fbcc9b8fc1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:40:20 user nova-compute[75288]: No targets found.
Nov 10 22:40:20 user nova-compute[75288]: iSNS:
Nov 10 22:40:20 user nova-compute[75288]: No targets found.
Nov 10 22:40:20 user nova-compute[75288]: STATIC:
Nov 10 22:40:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:40:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:40:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:40:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:40:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:40:20 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:40:20 user nova-compute[75288]: FIRMWARE:
Nov 10 22:40:20 user nova-compute[75288]: No targets found.
Nov 10 22:40:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:40:20 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:40:20 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7178fc-51e6-455d-9e53-3c0fe154d1f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1bade0-bdb9-4576-94c0-3602984e0d57]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:21 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:21 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b1036b6d0>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== disconnect_volume: return (85ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:40:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Deleting instance files /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf_del
Nov 10 22:40:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Deletion of /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf_del complete
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: INFO nova.virt.block_device [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Booting with volume 98e750ca-649c-455e-8880-fc1d2804501e at /dev/vdb
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.utils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e551c6-5b3b-4397-8413-c4ef5d9f2bf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bda6ce-d681-43e6-b78b-b997644c4a5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0ebcf0-0d78-4f6c-8948-4d215677a266]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77413124-3eaa-44a4-925d-994d4368d4b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:40:21 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92997fc-607c-4bcb-9fad-75ffcd57f9c5]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG os_brick.utils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updating existing volume attachment record: 28b720d6-5e63-45dd-8bb1-f4eae013ecb2 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:40:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid 'f9c056b7-56a6-4dd9-972b-7290c27c8fcf' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f9c056b7-56a6-4dd9-972b-7290c27c8fcf' (instance-0000000c)
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:40:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7574MB free_disk=25.441265106201172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 80788251-eb95-4022-8170-d219f083c64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 6b644952-4e1b-4df1-8923-462b988306ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 22:40:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.908s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:40:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 22:40:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 0 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 22:40:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 is timed out.
Nov 10 22:40:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully detached device vdc from instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 from the live domain config.
Nov 10 22:40:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKmSpJHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:40:35 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad91651c-03f3-4d56-91b9-d6d2a51f0080]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:40:35 user nova-compute[75288]: No targets found.
Nov 10 22:40:35 user nova-compute[75288]: iSNS:
Nov 10 22:40:35 user nova-compute[75288]: No targets found.
Nov 10 22:40:35 user nova-compute[75288]: STATIC:
Nov 10 22:40:35 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:40:35 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:40:35 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:40:35 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547
Nov 10 22:40:35 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:40:35 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:40:35 user nova-compute[75288]: FIRMWARE:
Nov 10 22:40:35 user nova-compute[75288]: No targets found.
Nov 10 22:40:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:40:35 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:40:35 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef409e2a-fa65-4157-9ac3-b713a42bcc5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf808bf-95ca-4d6a-a36c-aefb3add1d45]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:35 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 (non-flash)
Nov 10 22:40:35 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10324b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f279b5-856b-452b-8c4d-1cfe59375f61]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4b08e7-5392-463d-a856-73cbe4e6808a]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b40776-58c6-452a-a795-e0fe0e3d483d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5643b6-691b-4741-91ac-be8800d17661]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4a040-c76f-4f18-baa2-7463b587c14d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5f75e8-9d63-45d6-aa67-5cbf268e0be8]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260]
Nov 10 22:40:35 user nova-compute[75288]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547, portal: 172.16.0.220,3260] successful.
Nov 10 22:40:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e85fec-9286-49b5-81a2-ff2bdc4fe547 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7940b16c-0867-46b7-80a0-3464a63b578a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] <== disconnect_volume: return (349ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:40:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'flavor' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:40:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a1a050d4-eaa7-42c3-a206-ba363e759dfc tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.509s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:40:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Creating image(s)
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk 1073741824" returned: 0 in 0.054s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Cannot resize image /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Ensure instance console log exists: /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Start _get_guest_xml network_info=[{"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9c056b7-56a6-4dd9-972b-7290c27c8fcf', 'attached_at': '', 'detached_at': '', 'volume_id': '98e750ca-649c-455e-8880-fc1d2804501e', 'serial': '98e750ca-649c-455e-8880-fc1d2804501e'}, 'mount_device': '/dev/vdb', 'attachment_id': '28b720d6-5e63-45dd-8bb1-f4eae013ecb2', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:40:49 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 22:40:49 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:40:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:40:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:40:49 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f960df-001b-4105-aaeb-435814200888]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:40:49 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db55711-b315-4bfe-8fbe-b910a1e88eee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e] added
Nov 10 22:40:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db275f5-f79a-426a-816f-74f36a7e8f67]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2629ecc-2801-4ab6-8dd9-0da46fd27813]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilnGPsVK {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilnGPsVK" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f553f2-a811-4274-a0b8-1c98adcd63fd]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ilnGPsVK'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff55e01-5cd9-4871-90d6-4601d67c5e8d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[405b0bb8-a75d-47b1-ad5e-71331ed3c26c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[baba47ed-e9c8-4d26-a5cc-e1fd1b27672d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]
Nov 10 22:40:49 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.
Nov 10 22:40:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43890aed-877b-44e4-b361-6b9b22db3887]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[82326a27-b6ab-4724-94f1-7f759b1bdeaa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:49 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:40:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:40:49 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:40:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305bd0c-452b-494d-b53f-b8ea7adae739]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:40:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23135346363316665', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135346363316665', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-787401219',display_name='tempest-ServerActionsTestOtherA-server-706973279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-787401219',id=12,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgur9VwcRgcPAddQ2yq2SDKWwkCHOc79qk3MMstyvI4JbzUO7We++xhPD+OI0zsJ8ZIjY2xd7tJ3cZf88cGEqNEfrxS53zEnlcJXT2NxUBnilmBfl9N4p955pTEXCQ+jg==',key_name='tempest-keypair-1131382431',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:37:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-i8dgfs40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=f9c056b7-56a6-4dd9-972b-7290c27c8fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:40:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:40:50 user nova-compute[75288]:   <uuid>f9c056b7-56a6-4dd9-972b-7290c27c8fcf</uuid>
Nov 10 22:40:50 user nova-compute[75288]:   <name>instance-0000000c</name>
Nov 10 22:40:50 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:40:50 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:40:50 user nova-compute[75288]:   <metadata>
Nov 10 22:40:50 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:40:50 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:40:50 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-706973279</nova:name>
Nov 10 22:40:50 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:40:49</nova:creationTime>
Nov 10 22:40:50 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:40:50 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:40:50 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:40:50 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:40:50 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:40:50 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:40:50 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:40:50 user nova-compute[75288]:       <nova:owner>
Nov 10 22:40:50 user nova-compute[75288]:         <nova:user uuid="1839c7b8368947ccacf91af8fd6f0faf">tempest-ServerActionsTestOtherA-1568173136-project-member</nova:user>
Nov 10 22:40:50 user nova-compute[75288]:         <nova:project uuid="d01027aba7e1424390b507afbad93f23">tempest-ServerActionsTestOtherA-1568173136</nova:project>
Nov 10 22:40:50 user nova-compute[75288]:       </nova:owner>
Nov 10 22:40:50 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:40:50 user nova-compute[75288]:       <nova:ports>
Nov 10 22:40:50 user nova-compute[75288]:         <nova:port uuid="833ea9cc-5b3c-45d9-a790-58a325399f50">
Nov 10 22:40:50 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 22:40:50 user nova-compute[75288]:         </nova:port>
Nov 10 22:40:50 user nova-compute[75288]:       </nova:ports>
Nov 10 22:40:50 user nova-compute[75288]:     </nova:instance>
Nov 10 22:40:50 user nova-compute[75288]:   </metadata>
Nov 10 22:40:50 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:40:50 user nova-compute[75288]:     <system>
Nov 10 22:40:50 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:40:50 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:40:50 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:40:50 user nova-compute[75288]:       <entry name="serial">f9c056b7-56a6-4dd9-972b-7290c27c8fcf</entry>
Nov 10 22:40:50 user nova-compute[75288]:       <entry name="uuid">f9c056b7-56a6-4dd9-972b-7290c27c8fcf</entry>
Nov 10 22:40:50 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:40:50 user nova-compute[75288]:     </system>
Nov 10 22:40:50 user nova-compute[75288]:   </sysinfo>
Nov 10 22:40:50 user nova-compute[75288]:   <os>
Nov 10 22:40:50 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:40:50 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:40:50 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:40:50 user nova-compute[75288]:   </os>
Nov 10 22:40:50 user nova-compute[75288]:   <features>
Nov 10 22:40:50 user nova-compute[75288]:     <acpi/>
Nov 10 22:40:50 user nova-compute[75288]:     <apic/>
Nov 10 22:40:50 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:40:50 user nova-compute[75288]:   </features>
Nov 10 22:40:50 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:40:50 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:40:50 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:40:50 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:40:50 user nova-compute[75288]:   </clock>
Nov 10 22:40:50 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:40:50 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:40:50 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:40:50 user nova-compute[75288]:   </cpu>
Nov 10 22:40:50 user nova-compute[75288]:   <devices>
Nov 10 22:40:50 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:40:50 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:40:50 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk"/>
Nov 10 22:40:50 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:40:50 user nova-compute[75288]:     </disk>
Nov 10 22:40:50 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:40:50 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:40:50 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 22:40:50 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:40:50 user nova-compute[75288]:       <serial>98e750ca-649c-455e-8880-fc1d2804501e</serial>
Nov 10 22:40:50 user nova-compute[75288]:     </disk>
Nov 10 22:40:50 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:40:50 user nova-compute[75288]:       <mac address="fa:16:3e:ef:ad:c3"/>
Nov 10 22:40:50 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:40:50 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:40:50 user nova-compute[75288]:       <target dev="tap833ea9cc-5b"/>
Nov 10 22:40:50 user nova-compute[75288]:     </interface>
Nov 10 22:40:50 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:40:50 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/console.log" append="off"/>
Nov 10 22:40:50 user nova-compute[75288]:     </serial>
Nov 10 22:40:50 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:40:50 user nova-compute[75288]:     <video>
Nov 10 22:40:50 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:40:50 user nova-compute[75288]:     </video>
Nov 10 22:40:50 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:40:50 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:40:50 user nova-compute[75288]:     </rng>
Nov 10 22:40:50 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:40:50 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:40:50 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:40:50 user nova-compute[75288]:     </memballoon>
Nov 10 22:40:50 user nova-compute[75288]:   </devices>
Nov 10 22:40:50 user nova-compute[75288]: </domain>
Nov 10 22:40:50 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-787401219',display_name='tempest-ServerActionsTestOtherA-server-706973279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-787401219',id=12,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgur9VwcRgcPAddQ2yq2SDKWwkCHOc79qk3MMstyvI4JbzUO7We++xhPD+OI0zsJ8ZIjY2xd7tJ3cZf88cGEqNEfrxS53zEnlcJXT2NxUBnilmBfl9N4p955pTEXCQ+jg==',key_name='tempest-keypair-1131382431',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:37:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-i8dgfs40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=f9c056b7-56a6-4dd9-972b-7290c27c8fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG os_vif [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32496345-96ac-5d44-9d69-b6d3837f2e0d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap833ea9cc-5b, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap833ea9cc-5b, col_values=(('qos', UUID('5d474f96-4e87-4af2-8676-92f9a5574f48')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap833ea9cc-5b, col_values=(('external_ids', {'iface-id': '833ea9cc-5b3c-45d9-a790-58a325399f50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:ad:c3', 'vm-uuid': 'f9c056b7-56a6-4dd9-972b-7290c27c8fcf'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:51 user nova-compute[75288]: INFO os_vif [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b')
Nov 10 22:40:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:40:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No VIF found with MAC fa:16:3e:ef:ad:c3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:40:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-557f84bb-de59-401b-aac2-0547b6e1b535 req-0334d7fc-5b42-45dc-86f1-875e9e4aa178 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-557f84bb-de59-401b-aac2-0547b6e1b535 req-0334d7fc-5b42-45dc-86f1-875e9e4aa178 service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-557f84bb-de59-401b-aac2-0547b6e1b535 req-0334d7fc-5b42-45dc-86f1-875e9e4aa178 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-557f84bb-de59-401b-aac2-0547b6e1b535 req-0334d7fc-5b42-45dc-86f1-875e9e4aa178 service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-557f84bb-de59-401b-aac2-0547b6e1b535 req-0334d7fc-5b42-45dc-86f1-875e9e4aa178 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:40:53 user nova-compute[75288]: WARNING nova.compute.manager [req-557f84bb-de59-401b-aac2-0547b6e1b535 req-0334d7fc-5b42-45dc-86f1-875e9e4aa178 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received unexpected event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 22:40:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-d35196ab-e9cb-40fe-af4f-e3d36cacd23e req-9b3a047f-ec5a-41bb-b0f7-5631e7bbb38e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d35196ab-e9cb-40fe-af4f-e3d36cacd23e req-9b3a047f-ec5a-41bb-b0f7-5631e7bbb38e service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d35196ab-e9cb-40fe-af4f-e3d36cacd23e req-9b3a047f-ec5a-41bb-b0f7-5631e7bbb38e service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d35196ab-e9cb-40fe-af4f-e3d36cacd23e req-9b3a047f-ec5a-41bb-b0f7-5631e7bbb38e service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-d35196ab-e9cb-40fe-af4f-e3d36cacd23e req-9b3a047f-ec5a-41bb-b0f7-5631e7bbb38e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:40:55 user nova-compute[75288]: WARNING nova.compute.manager [req-d35196ab-e9cb-40fe-af4f-e3d36cacd23e req-9b3a047f-ec5a-41bb-b0f7-5631e7bbb38e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received unexpected event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:40:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance spawned successfully.
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75288) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 22:40:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-233d3d7b-5e93-4eae-9216-2c4f0f4ec510 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.104s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:40:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:40:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:40:59 user nova-compute[75288]: INFO nova.compute.manager [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] instance snapshotting
Nov 10 22:40:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Beginning live snapshot process
Nov 10 22:40:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json -f qcow2" returned: 0 in 0.233s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm54y92cz/c495e2ea9754433494e08abcd936ce53.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm54y92cz/c495e2ea9754433494e08abcd936ce53.delta 1073741824" returned: 0 in 0.080s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 22:41:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:41:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:41:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 22:41:02 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm54y92cz/c495e2ea9754433494e08abcd936ce53.delta /opt/stack/data/nova/instances/snapshots/tmpm54y92cz/c495e2ea9754433494e08abcd936ce53 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "6b644952-4e1b-4df1-8923-462b988306ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:02 user nova-compute[75288]: INFO nova.compute.manager [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Terminating instance
Nov 10 22:41:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm54y92cz/c495e2ea9754433494e08abcd936ce53.delta /opt/stack/data/nova/instances/snapshots/tmpm54y92cz/c495e2ea9754433494e08abcd936ce53" returned: 0 in 0.540s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Snapshot extracted, beginning image upload
Nov 10 22:41:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-43807efa-e00f-47a9-aea8-6d41653da56f req-2e13b73f-73ab-4c34-b5a9-2cb01e89717c service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-unplugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-43807efa-e00f-47a9-aea8-6d41653da56f req-2e13b73f-73ab-4c34-b5a9-2cb01e89717c service nova] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-43807efa-e00f-47a9-aea8-6d41653da56f req-2e13b73f-73ab-4c34-b5a9-2cb01e89717c service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-43807efa-e00f-47a9-aea8-6d41653da56f req-2e13b73f-73ab-4c34-b5a9-2cb01e89717c service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-43807efa-e00f-47a9-aea8-6d41653da56f req-2e13b73f-73ab-4c34-b5a9-2cb01e89717c service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] No waiting events found dispatching network-vif-unplugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-43807efa-e00f-47a9-aea8-6d41653da56f req-2e13b73f-73ab-4c34-b5a9-2cb01e89717c service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-unplugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Instance destroyed successfully.
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lazy-loading 'resources' on Instance uuid 6b644952-4e1b-4df1-8923-462b988306ee {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1257552266',display_name='tempest-VolumesAdminNegativeTest-server-1257552266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1257552266',id=14,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:38:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ddead166794fd4b660457f109f7bc3',ramdisk_id='',reservation_id='r-3mpegjr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1375484400',owner_user_name='tempest-VolumesAdminNegativeTest-1375484400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:38:58Z,user_data=None,user_id='8fe464c9138840019ac3a32c3c9bcfab',uuid=6b644952-4e1b-4df1-8923-462b988306ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converting VIF {"id": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "address": "fa:16:3e:a0:a6:fc", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02286fd6-e3", "ovs_interfaceid": "02286fd6-e3fa-47b9-b4d8-7c4d3e596033", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a6:fc,bridge_name='br-int',has_traffic_filtering=True,id=02286fd6-e3fa-47b9-b4d8-7c4d3e596033,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02286fd6-e3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG os_vif [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a6:fc,bridge_name='br-int',has_traffic_filtering=True,id=02286fd6-e3fa-47b9-b4d8-7c4d3e596033,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02286fd6-e3') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02286fd6-e3, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab71f17b-e6b6-4f7d-9f7d-08d532d2695e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: INFO os_vif [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a6:fc,bridge_name='br-int',has_traffic_filtering=True,id=02286fd6-e3fa-47b9-b4d8-7c4d3e596033,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02286fd6-e3')
Nov 10 22:41:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Deleting instance files /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee_del
Nov 10 22:41:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Deletion of /opt/stack/data/nova/instances/6b644952-4e1b-4df1-8923-462b988306ee_del complete
Nov 10 22:41:03 user nova-compute[75288]: INFO nova.compute.manager [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 10 22:41:03 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:04 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Took 0.65 seconds to deallocate network for instance.
Nov 10 22:41:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-0aeb8133-1fbb-403c-9cb1-a7d97e3463fb req-e1e9bcca-56e8-41e1-86b0-f19e3ed28c0f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-deleted-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:04 user nova-compute[75288]: INFO nova.compute.manager [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Terminating instance
Nov 10 22:41:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:05 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Deleted allocations for instance 6b644952-4e1b-4df1-8923-462b988306ee
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-513d4caf-54fb-427f-bb2c-aa682ba48d52 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "6b644952-4e1b-4df1-8923-462b988306ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] No waiting events found dispatching network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:05 user nova-compute[75288]: WARNING nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received unexpected event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 for instance with vm_state deleted and task_state None.
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] No waiting events found dispatching network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:05 user nova-compute[75288]: WARNING nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received unexpected event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 for instance with vm_state deleted and task_state None.
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] No waiting events found dispatching network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:05 user nova-compute[75288]: WARNING nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received unexpected event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 for instance with vm_state deleted and task_state None.
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Acquiring lock "6b644952-4e1b-4df1-8923-462b988306ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] Lock "6b644952-4e1b-4df1-8923-462b988306ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] No waiting events found dispatching network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:05 user nova-compute[75288]: WARNING nova.compute.manager [req-714c74e4-11be-4964-b768-f9a299c24383 req-3840062e-7754-4b0d-bbac-30ebcf26e54f service nova] [instance: 6b644952-4e1b-4df1-8923-462b988306ee] Received unexpected event network-vif-plugged-02286fd6-e3fa-47b9-b4d8-7c4d3e596033 for instance with vm_state deleted and task_state None.
Nov 10 22:41:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Instance destroyed successfully.
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'resources' on Instance uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-629412587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-629412587',id=3,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsn8RWoTM33U1Wn0XsXWYmBTav3JNsALpJyij1IuoeHWuaRZv8F9nZwHxJycfYTGcA1LdY/Ync7tOpUMY/NKULD8AnmpUADEYZqDSbY5SSjQyoO/dCs/0YMw11L2zKauQ==',key_name='tempest-keypair-864991346',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-qnxqgmhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=a1701e0c-f9c9-4ba8-81ec-1b9966e033a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "address": "fa:16:3e:8b:e8:23", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0404036a-dd", "ovs_interfaceid": "0404036a-dd85-4ebb-9d1d-4728ae7270ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG os_vif [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0404036a-dd, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d23cca19-aa80-4a4a-8c9c-98ca166b947b) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:05 user nova-compute[75288]: INFO os_vif [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=0404036a-dd85-4ebb-9d1d-4728ae7270ed,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0404036a-dd')
Nov 10 22:41:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Deleting instance files /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3_del
Nov 10 22:41:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Deletion of /opt/stack/data/nova/instances/a1701e0c-f9c9-4ba8-81ec-1b9966e033a3_del complete
Nov 10 22:41:05 user nova-compute[75288]: INFO nova.compute.manager [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 10 22:41:05 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:41:05 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-0ffb86d2-085b-4d7e-91e5-4f6aacd9cf30 req-7f56384c-4012-4489-8d8e-7d08eb874699 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-deleted-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:07 user nova-compute[75288]: INFO nova.compute.manager [req-0ffb86d2-085b-4d7e-91e5-4f6aacd9cf30 req-7f56384c-4012-4489-8d8e-7d08eb874699 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Neutron deleted interface 0404036a-dd85-4ebb-9d1d-4728ae7270ed; detaching it from the instance and deleting it from the info cache
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.network.neutron [req-0ffb86d2-085b-4d7e-91e5-4f6aacd9cf30 req-7f56384c-4012-4489-8d8e-7d08eb874699 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:07 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Took 1.38 seconds to deallocate network for instance.
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-0ffb86d2-085b-4d7e-91e5-4f6aacd9cf30 req-7f56384c-4012-4489-8d8e-7d08eb874699 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Detach interface failed, port_id=0404036a-dd85-4ebb-9d1d-4728ae7270ed, reason: Instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-unplugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-unplugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-unplugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] No waiting events found dispatching network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:07 user nova-compute[75288]: WARNING nova.compute.manager [req-493942db-0c6c-4502-b776-246d854e95d6 req-601ab7aa-e34f-43a2-a63b-20a34c406118 service nova] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] Received unexpected event network-vif-plugged-0404036a-dd85-4ebb-9d1d-4728ae7270ed for instance with vm_state active and task_state deleting.
Nov 10 22:41:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Snapshot image upload complete
Nov 10 22:41:07 user nova-compute[75288]: INFO nova.compute.manager [None req-fa9219f0-0ddf-401e-a009-b818719f3831 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Took 7.90 seconds to snapshot the instance on the hypervisor.
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: WARNING nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 032de95e-98a7-411d-8726-5bf3a5c0ca49 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 5f06057c-abec-4ae3-ac9e-2cdede2cad3f {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 80788251-eb95-4022-8170-d219f083c64f {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 9bb377b7-e5a5-480f-9dd9-7d4e650841eb {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid a1701e0c-f9c9-4ba8-81ec-1b9966e033a3 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "80788251-eb95-4022-8170-d219f083c64f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: INFO nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] During sync_power_state the instance has a pending task (image_uploading). Skip.
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "80788251-eb95-4022-8170-d219f083c64f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.456s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:07 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:41:07 user nova-compute[75288]: INFO nova.compute.claims [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Claim successful on node user
Nov 10 22:41:07 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Deleted allocations for instance a1701e0c-f9c9-4ba8-81ec-1b9966e033a3
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a4b8037-baf4-4699-bf35-73a6c830fcd9 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.423s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.678s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:08 user nova-compute[75288]: INFO nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: a1701e0c-f9c9-4ba8-81ec-1b9966e033a3] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "a1701e0c-f9c9-4ba8-81ec-1b9966e033a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:41:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:41:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Creating image(s)
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "/opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "/opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:08 user nova-compute[75288]: DEBUG nova.policy [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd980521518bc4984891b95b73a1a4b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1081931234049bfa339c53bc493c3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.243s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.230s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk 1073741824" returned: 0 in 0.220s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.458s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:41:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Cannot resize image /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Ensure instance console log exists: /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Successfully created port: c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:41:10 user nova-compute[75288]: INFO nova.compute.claims [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Claim successful on node user
Nov 10 22:41:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:41:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Successfully updated port: c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquired lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.policy [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '824744a11e9d4e4d9095fb0558632e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f4e0a73b542a8a78c748a4d1c5914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-changed-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Refreshing instance network info cache due to event network-changed-c1696001-71da-4a44-b142-02f5e0248e99. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] Acquiring lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:41:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Creating image(s)
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "/opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "/opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "/opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Updating instance_info_cache with network_info: [{"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Releasing lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Instance network_info: |[{"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] Acquired lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Refreshing network info cache for port c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Start _get_guest_xml network_info=[{"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk 1073741824" returned: 0 in 0.070s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:41:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:41:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1313417894',display_name='tempest-TestVolumeSwap-server-1313417894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1313417894',id=17,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6Unm1D1ckU3FNB7leJUmhJKSAC/Us2wY1bg4EUpy4iNWvHGbpcs/Vzd1FJxSGRQkOX2R0kX8oyXa6Zwa9Nx1QZgwfpfqJSClFFlUeSKLeGnfiYu7DW9VWarC+1fsiBPg==',key_name='tempest-keypair-631041237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1081931234049bfa339c53bc493c3d0',ramdisk_id='',reservation_id='r-esd1ywzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-565048462',owner_user_name='tempest-TestVolumeSwap-565048462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d980521518bc4984891b95b73a1a4b4f',uuid=5bce81d0-809c-4c80-8740-c0277d7a290d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Converting VIF {"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:ea,bridge_name='br-int',has_traffic_filtering=True,id=c1696001-71da-4a44-b142-02f5e0248e99,network=Network(23f5c1d4-ddd5-46f1-85e6-7338660d69fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1696001-71') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:41:12 user nova-compute[75288]:   <uuid>5bce81d0-809c-4c80-8740-c0277d7a290d</uuid>
Nov 10 22:41:12 user nova-compute[75288]:   <name>instance-00000011</name>
Nov 10 22:41:12 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:41:12 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:41:12 user nova-compute[75288]:   <metadata>
Nov 10 22:41:12 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:41:12 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:41:12 user nova-compute[75288]:       <nova:name>tempest-TestVolumeSwap-server-1313417894</nova:name>
Nov 10 22:41:12 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:41:11</nova:creationTime>
Nov 10 22:41:12 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:41:12 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:41:12 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:41:12 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:41:12 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:41:12 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:41:12 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:41:12 user nova-compute[75288]:       <nova:owner>
Nov 10 22:41:12 user nova-compute[75288]:         <nova:user uuid="d980521518bc4984891b95b73a1a4b4f">tempest-TestVolumeSwap-565048462-project-member</nova:user>
Nov 10 22:41:12 user nova-compute[75288]:         <nova:project uuid="b1081931234049bfa339c53bc493c3d0">tempest-TestVolumeSwap-565048462</nova:project>
Nov 10 22:41:12 user nova-compute[75288]:       </nova:owner>
Nov 10 22:41:12 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:41:12 user nova-compute[75288]:       <nova:ports>
Nov 10 22:41:12 user nova-compute[75288]:         <nova:port uuid="c1696001-71da-4a44-b142-02f5e0248e99">
Nov 10 22:41:12 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 22:41:12 user nova-compute[75288]:         </nova:port>
Nov 10 22:41:12 user nova-compute[75288]:       </nova:ports>
Nov 10 22:41:12 user nova-compute[75288]:     </nova:instance>
Nov 10 22:41:12 user nova-compute[75288]:   </metadata>
Nov 10 22:41:12 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:41:12 user nova-compute[75288]:     <system>
Nov 10 22:41:12 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:41:12 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:41:12 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:41:12 user nova-compute[75288]:       <entry name="serial">5bce81d0-809c-4c80-8740-c0277d7a290d</entry>
Nov 10 22:41:12 user nova-compute[75288]:       <entry name="uuid">5bce81d0-809c-4c80-8740-c0277d7a290d</entry>
Nov 10 22:41:12 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:41:12 user nova-compute[75288]:     </system>
Nov 10 22:41:12 user nova-compute[75288]:   </sysinfo>
Nov 10 22:41:12 user nova-compute[75288]:   <os>
Nov 10 22:41:12 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:41:12 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:41:12 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:41:12 user nova-compute[75288]:   </os>
Nov 10 22:41:12 user nova-compute[75288]:   <features>
Nov 10 22:41:12 user nova-compute[75288]:     <acpi/>
Nov 10 22:41:12 user nova-compute[75288]:     <apic/>
Nov 10 22:41:12 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:41:12 user nova-compute[75288]:   </features>
Nov 10 22:41:12 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:41:12 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:41:12 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:41:12 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:41:12 user nova-compute[75288]:   </clock>
Nov 10 22:41:12 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:41:12 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:41:12 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:41:12 user nova-compute[75288]:   </cpu>
Nov 10 22:41:12 user nova-compute[75288]:   <devices>
Nov 10 22:41:12 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:41:12 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:41:12 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk"/>
Nov 10 22:41:12 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:41:12 user nova-compute[75288]:     </disk>
Nov 10 22:41:12 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:41:12 user nova-compute[75288]:       <mac address="fa:16:3e:11:29:ea"/>
Nov 10 22:41:12 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:41:12 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:41:12 user nova-compute[75288]:       <target dev="tapc1696001-71"/>
Nov 10 22:41:12 user nova-compute[75288]:     </interface>
Nov 10 22:41:12 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:41:12 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/console.log" append="off"/>
Nov 10 22:41:12 user nova-compute[75288]:     </serial>
Nov 10 22:41:12 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:41:12 user nova-compute[75288]:     <video>
Nov 10 22:41:12 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:41:12 user nova-compute[75288]:     </video>
Nov 10 22:41:12 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:41:12 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:41:12 user nova-compute[75288]:     </rng>
Nov 10 22:41:12 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:41:12 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:41:12 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:41:12 user nova-compute[75288]:     </memballoon>
Nov 10 22:41:12 user nova-compute[75288]:   </devices>
Nov 10 22:41:12 user nova-compute[75288]: </domain>
Nov 10 22:41:12 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1313417894',display_name='tempest-TestVolumeSwap-server-1313417894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1313417894',id=17,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6Unm1D1ckU3FNB7leJUmhJKSAC/Us2wY1bg4EUpy4iNWvHGbpcs/Vzd1FJxSGRQkOX2R0kX8oyXa6Zwa9Nx1QZgwfpfqJSClFFlUeSKLeGnfiYu7DW9VWarC+1fsiBPg==',key_name='tempest-keypair-631041237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1081931234049bfa339c53bc493c3d0',ramdisk_id='',reservation_id='r-esd1ywzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-565048462',owner_user_name='tempest-TestVolumeSwap-565048462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d980521518bc4984891b95b73a1a4b4f',uuid=5bce81d0-809c-4c80-8740-c0277d7a290d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Converting VIF {"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:ea,bridge_name='br-int',has_traffic_filtering=True,id=c1696001-71da-4a44-b142-02f5e0248e99,network=Network(23f5c1d4-ddd5-46f1-85e6-7338660d69fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1696001-71') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG os_vif [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:ea,bridge_name='br-int',has_traffic_filtering=True,id=c1696001-71da-4a44-b142-02f5e0248e99,network=Network(23f5c1d4-ddd5-46f1-85e6-7338660d69fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1696001-71') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65a8832f-0061-5c02-8706-65a10f263849', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1696001-71, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1696001-71, col_values=(('qos', UUID('35375c00-0bd8-4ee8-9ea5-0eb5c8acfa92')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1696001-71, col_values=(('external_ids', {'iface-id': 'c1696001-71da-4a44-b142-02f5e0248e99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:29:ea', 'vm-uuid': '5bce81d0-809c-4c80-8740-c0277d7a290d'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:12 user nova-compute[75288]: INFO os_vif [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:ea,bridge_name='br-int',has_traffic_filtering=True,id=c1696001-71da-4a44-b142-02f5e0248e99,network=Network(23f5c1d4-ddd5-46f1-85e6-7338660d69fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1696001-71')
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Successfully created port: 7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] No VIF found with MAC fa:16:3e:11:29:ea, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Cannot resize image /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Ensure instance console log exists: /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Updated VIF entry in instance network info cache for port c1696001-71da-4a44-b142-02f5e0248e99. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Updating instance_info_cache with network_info: [{"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-476c9b5c-c843-4a63-a7a9-fa3f991e4f95 req-e95f5fa5-b888-4e07-ad46-48d3a42085d9 service nova] Releasing lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Successfully updated port: 7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquired lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-changed-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Refreshing instance network info cache due to event network-changed-7ed0c9fb-6897-425d-8c29-ba63bfd452d6. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] Acquiring lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updating instance_info_cache with network_info: [{"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Releasing lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Instance network_info: |[{"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] Acquired lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Refreshing network info cache for port 7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Start _get_guest_xml network_info=[{"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:41:13 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:41:13 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:41:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-671503018',display_name='tempest-TestStampPattern-server-671503018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-671503018',id=18,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhOyHQ/mMcppCwCJUcBtZB9RAsC8DcDZYbZel44qDgENac/guD67yMkwHCAMOuJ/b/WnIA9XMdWVs2PHqnRCV/vU+mu+EYcKal9GrSkHUYouqZemEhNE4qY9vOyDF7nA==',key_name='tempest-TestStampPattern-1399113466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f2f4e0a73b542a8a78c748a4d1c5914',ramdisk_id='',reservation_id='r-2bhrdarm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2137207160',owner_user_name='tempest-TestStampPattern-2137207160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:41:11Z,user_data=None,user_id='824744a11e9d4e4d9095fb0558632e00',uuid=70c0e693-25bf-45bb-80b8-a3829e58a067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converting VIF {"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:04,bridge_name='br-int',has_traffic_filtering=True,id=7ed0c9fb-6897-425d-8c29-ba63bfd452d6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0c9fb-68') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'pci_devices' on Instance uuid 70c0e693-25bf-45bb-80b8-a3829e58a067 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:41:14 user nova-compute[75288]:   <uuid>70c0e693-25bf-45bb-80b8-a3829e58a067</uuid>
Nov 10 22:41:14 user nova-compute[75288]:   <name>instance-00000012</name>
Nov 10 22:41:14 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:41:14 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:41:14 user nova-compute[75288]:   <metadata>
Nov 10 22:41:14 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:41:14 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:41:14 user nova-compute[75288]:       <nova:name>tempest-TestStampPattern-server-671503018</nova:name>
Nov 10 22:41:14 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:41:13</nova:creationTime>
Nov 10 22:41:14 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:41:14 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:41:14 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:41:14 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:41:14 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:41:14 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:41:14 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:41:14 user nova-compute[75288]:       <nova:owner>
Nov 10 22:41:14 user nova-compute[75288]:         <nova:user uuid="824744a11e9d4e4d9095fb0558632e00">tempest-TestStampPattern-2137207160-project-member</nova:user>
Nov 10 22:41:14 user nova-compute[75288]:         <nova:project uuid="3f2f4e0a73b542a8a78c748a4d1c5914">tempest-TestStampPattern-2137207160</nova:project>
Nov 10 22:41:14 user nova-compute[75288]:       </nova:owner>
Nov 10 22:41:14 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:41:14 user nova-compute[75288]:       <nova:ports>
Nov 10 22:41:14 user nova-compute[75288]:         <nova:port uuid="7ed0c9fb-6897-425d-8c29-ba63bfd452d6">
Nov 10 22:41:14 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 22:41:14 user nova-compute[75288]:         </nova:port>
Nov 10 22:41:14 user nova-compute[75288]:       </nova:ports>
Nov 10 22:41:14 user nova-compute[75288]:     </nova:instance>
Nov 10 22:41:14 user nova-compute[75288]:   </metadata>
Nov 10 22:41:14 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:41:14 user nova-compute[75288]:     <system>
Nov 10 22:41:14 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:41:14 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:41:14 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:41:14 user nova-compute[75288]:       <entry name="serial">70c0e693-25bf-45bb-80b8-a3829e58a067</entry>
Nov 10 22:41:14 user nova-compute[75288]:       <entry name="uuid">70c0e693-25bf-45bb-80b8-a3829e58a067</entry>
Nov 10 22:41:14 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:41:14 user nova-compute[75288]:     </system>
Nov 10 22:41:14 user nova-compute[75288]:   </sysinfo>
Nov 10 22:41:14 user nova-compute[75288]:   <os>
Nov 10 22:41:14 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:41:14 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:41:14 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:41:14 user nova-compute[75288]:   </os>
Nov 10 22:41:14 user nova-compute[75288]:   <features>
Nov 10 22:41:14 user nova-compute[75288]:     <acpi/>
Nov 10 22:41:14 user nova-compute[75288]:     <apic/>
Nov 10 22:41:14 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:41:14 user nova-compute[75288]:   </features>
Nov 10 22:41:14 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:41:14 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:41:14 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:41:14 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:41:14 user nova-compute[75288]:   </clock>
Nov 10 22:41:14 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:41:14 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:41:14 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:41:14 user nova-compute[75288]:   </cpu>
Nov 10 22:41:14 user nova-compute[75288]:   <devices>
Nov 10 22:41:14 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:41:14 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:41:14 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk"/>
Nov 10 22:41:14 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:41:14 user nova-compute[75288]:     </disk>
Nov 10 22:41:14 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:41:14 user nova-compute[75288]:       <mac address="fa:16:3e:bc:39:04"/>
Nov 10 22:41:14 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:41:14 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:41:14 user nova-compute[75288]:       <target dev="tap7ed0c9fb-68"/>
Nov 10 22:41:14 user nova-compute[75288]:     </interface>
Nov 10 22:41:14 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:41:14 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/console.log" append="off"/>
Nov 10 22:41:14 user nova-compute[75288]:     </serial>
Nov 10 22:41:14 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:41:14 user nova-compute[75288]:     <video>
Nov 10 22:41:14 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:41:14 user nova-compute[75288]:     </video>
Nov 10 22:41:14 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:41:14 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:41:14 user nova-compute[75288]:     </rng>
Nov 10 22:41:14 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:41:14 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:41:14 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:41:14 user nova-compute[75288]:     </memballoon>
Nov 10 22:41:14 user nova-compute[75288]:   </devices>
Nov 10 22:41:14 user nova-compute[75288]: </domain>
Nov 10 22:41:14 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-671503018',display_name='tempest-TestStampPattern-server-671503018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-671503018',id=18,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhOyHQ/mMcppCwCJUcBtZB9RAsC8DcDZYbZel44qDgENac/guD67yMkwHCAMOuJ/b/WnIA9XMdWVs2PHqnRCV/vU+mu+EYcKal9GrSkHUYouqZemEhNE4qY9vOyDF7nA==',key_name='tempest-TestStampPattern-1399113466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f2f4e0a73b542a8a78c748a4d1c5914',ramdisk_id='',reservation_id='r-2bhrdarm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2137207160',owner_user_name='tempest-TestStampPattern-2137207160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:41:11Z,user_data=None,user_id='824744a11e9d4e4d9095fb0558632e00',uuid=70c0e693-25bf-45bb-80b8-a3829e58a067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converting VIF {"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:04,bridge_name='br-int',has_traffic_filtering=True,id=7ed0c9fb-6897-425d-8c29-ba63bfd452d6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0c9fb-68') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG os_vif [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:04,bridge_name='br-int',has_traffic_filtering=True,id=7ed0c9fb-6897-425d-8c29-ba63bfd452d6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0c9fb-68') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05b043e5-7191-5e67-8db5-8cbb7619015b', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ed0c9fb-68, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ed0c9fb-68, col_values=(('qos', UUID('518b221e-b2b6-4cb9-befe-848b72e73472')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ed0c9fb-68, col_values=(('external_ids', {'iface-id': '7ed0c9fb-6897-425d-8c29-ba63bfd452d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:39:04', 'vm-uuid': '70c0e693-25bf-45bb-80b8-a3829e58a067'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: INFO os_vif [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:39:04,bridge_name='br-int',has_traffic_filtering=True,id=7ed0c9fb-6897-425d-8c29-ba63bfd452d6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0c9fb-68')
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No VIF found with MAC fa:16:3e:bc:39:04, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-28f8af79-4dcf-4206-8433-ee6f377d9818 req-5e290904-4fef-449c-aef8-f948b8fb731c service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28f8af79-4dcf-4206-8433-ee6f377d9818 req-5e290904-4fef-449c-aef8-f948b8fb731c service nova] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28f8af79-4dcf-4206-8433-ee6f377d9818 req-5e290904-4fef-449c-aef8-f948b8fb731c service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28f8af79-4dcf-4206-8433-ee6f377d9818 req-5e290904-4fef-449c-aef8-f948b8fb731c service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-28f8af79-4dcf-4206-8433-ee6f377d9818 req-5e290904-4fef-449c-aef8-f948b8fb731c service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] No waiting events found dispatching network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:14 user nova-compute[75288]: WARNING nova.compute.manager [req-28f8af79-4dcf-4206-8433-ee6f377d9818 req-5e290904-4fef-449c-aef8-f948b8fb731c service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received unexpected event network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 for instance with vm_state building and task_state spawning.
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updated VIF entry in instance network info cache for port 7ed0c9fb-6897-425d-8c29-ba63bfd452d6. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updating instance_info_cache with network_info: [{"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da9d73df-90e9-489b-baa2-a4a0a2936b4f req-9b25612d-1cee-4ef2-a722-ac9ffd5c64d9 service nova] Releasing lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.012s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] No waiting events found dispatching network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:16 user nova-compute[75288]: WARNING nova.compute.manager [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received unexpected event network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 for instance with vm_state building and task_state spawning.
Nov 10 22:41:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:16 user nova-compute[75288]: WARNING nova.compute.manager [req-84a7d9f8-b5ec-4aa1-8be9-a9120bf7d17d req-9484d132-bb0f-45b1-b10c-77e5aaa7b1ab service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received unexpected event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with vm_state building and task_state spawning.
Nov 10 22:41:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:41:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Instance spawned successfully.
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: INFO nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Took 9.53 seconds to spawn the instance on the hypervisor.
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:41:18 user nova-compute[75288]: INFO nova.compute.manager [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Took 11.08 seconds to build instance.
Nov 10 22:41:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ef6ceb3-c757-410f-8f87-e0a4817995b7 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.265s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-76679100-a3b0-4545-9aad-507ea1c33b16 req-15f8c761-d210-4d55-9d5c-23f32c928f8d service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-76679100-a3b0-4545-9aad-507ea1c33b16 req-15f8c761-d210-4d55-9d5c-23f32c928f8d service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-76679100-a3b0-4545-9aad-507ea1c33b16 req-15f8c761-d210-4d55-9d5c-23f32c928f8d service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-76679100-a3b0-4545-9aad-507ea1c33b16 req-15f8c761-d210-4d55-9d5c-23f32c928f8d service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-76679100-a3b0-4545-9aad-507ea1c33b16 req-15f8c761-d210-4d55-9d5c-23f32c928f8d service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:18 user nova-compute[75288]: WARNING nova.compute.manager [req-76679100-a3b0-4545-9aad-507ea1c33b16 req-15f8c761-d210-4d55-9d5c-23f32c928f8d service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received unexpected event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with vm_state building and task_state spawning.
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:41:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Instance spawned successfully.
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:41:18 user nova-compute[75288]: INFO nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Took 7.42 seconds to spawn the instance on the hypervisor.
Nov 10 22:41:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:41:18 user nova-compute[75288]: INFO nova.compute.manager [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Took 8.47 seconds to build instance.
Nov 10 22:41:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05636a2b-dd4d-47b7-95d3-9cc99e10e7a4 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.611s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:41:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:41:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:41:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:41:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:41:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:41:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7858MB free_disk=25.432083129882812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 80788251-eb95-4022-8170-d219f083c64f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5bce81d0-809c-4c80-8740-c0277d7a290d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:41:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:41:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:41:26 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:41:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:41:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:41:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:32 user nova-compute[75288]: INFO nova.compute.manager [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Detaching volume 089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:41:32 user nova-compute[75288]: INFO nova.virt.block_device [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Attempting to driver detach volume 089d5b73-557a-4352-abe4-552db2b71a3f from mountpoint /dev/vdb
Nov 10 22:41:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Attempting to detach device vdb from instance 33ebbf72-0319-4e06-af0c-cf1462053666 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:41:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:41:32 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:41:32 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:41:32 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:41:32 user nova-compute[75288]:   <serial>089d5b73-557a-4352-abe4-552db2b71a3f</serial>
Nov 10 22:41:32 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:41:32 user nova-compute[75288]: </disk>
Nov 10 22:41:32 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:41:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully detached device vdb from instance 33ebbf72-0319-4e06-af0c-cf1462053666 from the persistent domain config.
Nov 10 22:41:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33ebbf72-0319-4e06-af0c-cf1462053666 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:41:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:41:32 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:41:32 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:41:32 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:41:32 user nova-compute[75288]:   <serial>089d5b73-557a-4352-abe4-552db2b71a3f</serial>
Nov 10 22:41:32 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:41:32 user nova-compute[75288]: </disk>
Nov 10 22:41:32 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:41:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:41:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-changed-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Refreshing instance network info cache due to event network-changed-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:41:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:41:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:41:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Refreshing network info cache for port 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:41:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updated VIF entry in instance network info cache for port 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:41:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:41:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66b080c6-7e72-49a2-ae70-c4cb2f982676 req-8cc4ba03-7833-4282-ba17-97a4e0a2d310 service nova] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:41:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:53 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33ebbf72-0319-4e06-af0c-cf1462053666 is timed out.
Nov 10 22:41:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully detached device vdb from instance 33ebbf72-0319-4e06-af0c-cf1462053666 from the live domain config.
Nov 10 22:41:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJhnapHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:41:53 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac400f4-713d-4fe4-9150-79a543538b36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:41:53 user nova-compute[75288]: No targets found.
Nov 10 22:41:53 user nova-compute[75288]: iSNS:
Nov 10 22:41:53 user nova-compute[75288]: No targets found.
Nov 10 22:41:53 user nova-compute[75288]: STATIC:
Nov 10 22:41:53 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f
Nov 10 22:41:53 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:41:53 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:41:53 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e
Nov 10 22:41:53 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:41:53 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:41:53 user nova-compute[75288]: FIRMWARE:
Nov 10 22:41:53 user nova-compute[75288]: No targets found.
Nov 10 22:41:53 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:41:53 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:41:53 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb96efe5-8c68-471f-bf85-644acd7119d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5347174-ee80-4e42-87df-8c74f384f6b2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:41:53 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:41:53 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f (non-flash)
Nov 10 22:41:53 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:41:53 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10349bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[73675a72-264e-4cf3-a4af-7700adeee617]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[202244af-1530-468e-9ccb-c9f1d5e06a99]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3205d1-cb46-4300-8674-cb5a6b323955]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6726916-df2c-4cdd-b69e-9b1908906331]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e9d071-9e89-4121-b959-8173dd06c9fa]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[82979b06-577c-46e7-a632-eb6541c77d02]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260]
Nov 10 22:41:53 user nova-compute[75288]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f, portal: 172.16.0.220,3260] successful.
Nov 10 22:41:53 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:089d5b73-557a-4352-abe4-552db2b71a3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b60acd-e810-4675-a247-9035ed09f1b1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== disconnect_volume: return (297ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:41:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:41:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:41:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea70e619-8ea9-4fa2-a777-c3daf93bf695 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5562e515-fa02-4ca8-98a3-020b867d0e2c tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5562e515-fa02-4ca8-98a3-020b867d0e2c tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5562e515-fa02-4ca8-98a3-020b867d0e2c tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5562e515-fa02-4ca8-98a3-020b867d0e2c tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75288) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5562e515-fa02-4ca8-98a3-020b867d0e2c tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-585e6aef-89f6-449e-92b2-7da3dc05a903 req-f003dbe2-126e-4b10-93b3-6b9d4a0b7c1d service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-585e6aef-89f6-449e-92b2-7da3dc05a903 req-f003dbe2-126e-4b10-93b3-6b9d4a0b7c1d service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-585e6aef-89f6-449e-92b2-7da3dc05a903 req-f003dbe2-126e-4b10-93b3-6b9d4a0b7c1d service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-585e6aef-89f6-449e-92b2-7da3dc05a903 req-f003dbe2-126e-4b10-93b3-6b9d4a0b7c1d service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-585e6aef-89f6-449e-92b2-7da3dc05a903 req-f003dbe2-126e-4b10-93b3-6b9d4a0b7c1d service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:55 user nova-compute[75288]: WARNING nova.compute.manager [req-585e6aef-89f6-449e-92b2-7da3dc05a903 req-f003dbe2-126e-4b10-93b3-6b9d4a0b7c1d service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state active and task_state powering-off.
Nov 10 22:41:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance destroyed successfully.
Nov 10 22:41:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5562e515-fa02-4ca8-98a3-020b867d0e2c tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:41:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5562e515-fa02-4ca8-98a3-020b867d0e2c tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.901s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-d58b2c87-38e8-4fb8-8033-9dc963327019 req-ba90bc5c-158f-494c-a823-6989ee3aa7d8 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:41:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d58b2c87-38e8-4fb8-8033-9dc963327019 req-ba90bc5c-158f-494c-a823-6989ee3aa7d8 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d58b2c87-38e8-4fb8-8033-9dc963327019 req-ba90bc5c-158f-494c-a823-6989ee3aa7d8 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d58b2c87-38e8-4fb8-8033-9dc963327019 req-ba90bc5c-158f-494c-a823-6989ee3aa7d8 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-d58b2c87-38e8-4fb8-8033-9dc963327019 req-ba90bc5c-158f-494c-a823-6989ee3aa7d8 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:41:57 user nova-compute[75288]: WARNING nova.compute.manager [req-d58b2c87-38e8-4fb8-8033-9dc963327019 req-ba90bc5c-158f-494c-a823-6989ee3aa7d8 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state stopped and task_state None.
Nov 10 22:41:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:41:59 user nova-compute[75288]: INFO nova.compute.claims [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Claim successful on node user
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:41:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:41:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.policy [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05f170ae42004d57abea1bf318d05dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f6c30d0f1a467f8e977a73463e2d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:42:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Creating image(s)
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk 1073741824" returned: 0 in 0.056s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Successfully created port: 004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Cannot resize image /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Ensure instance console log exists: /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Successfully updated port: 004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquired lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing instance network info cache due to event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] Acquiring lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Releasing lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance network_info: |[{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] Acquired lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Start _get_guest_xml network_info=[{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:42:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:42:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-348158825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-348158825',id=19,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl3bnDr6iWD2rDxViaXHLOHvBAxs6kgwoH4KHi0DyqdB+X0ShLlFByhguU1fNi4/if+gomSn7bK/KT9k2KIha7W5cZLDZnZLRjdK9prTch89nrolMuTJz6JRNi6ZY3J9g==',key_name='tempest-keypair-276005353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-lihpwz8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=42be4921-aac5-4ee5-9564-455e9558ded0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'pci_devices' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:42:01 user nova-compute[75288]:   <uuid>42be4921-aac5-4ee5-9564-455e9558ded0</uuid>
Nov 10 22:42:01 user nova-compute[75288]:   <name>instance-00000013</name>
Nov 10 22:42:01 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:42:01 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:42:01 user nova-compute[75288]:   <metadata>
Nov 10 22:42:01 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:42:01 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:42:01 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-348158825</nova:name>
Nov 10 22:42:01 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:42:01</nova:creationTime>
Nov 10 22:42:01 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:42:01 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:42:01 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:42:01 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:42:01 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:42:01 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:42:01 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:42:01 user nova-compute[75288]:       <nova:owner>
Nov 10 22:42:01 user nova-compute[75288]:         <nova:user uuid="05f170ae42004d57abea1bf318d05dab">tempest-AttachVolumeShelveTestJSON-1618351090-project-member</nova:user>
Nov 10 22:42:01 user nova-compute[75288]:         <nova:project uuid="53f6c30d0f1a467f8e977a73463e2d1e">tempest-AttachVolumeShelveTestJSON-1618351090</nova:project>
Nov 10 22:42:01 user nova-compute[75288]:       </nova:owner>
Nov 10 22:42:01 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:42:01 user nova-compute[75288]:       <nova:ports>
Nov 10 22:42:01 user nova-compute[75288]:         <nova:port uuid="004daad5-a7a8-4929-8faf-aa904b1c2bb4">
Nov 10 22:42:01 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 22:42:01 user nova-compute[75288]:         </nova:port>
Nov 10 22:42:01 user nova-compute[75288]:       </nova:ports>
Nov 10 22:42:01 user nova-compute[75288]:     </nova:instance>
Nov 10 22:42:01 user nova-compute[75288]:   </metadata>
Nov 10 22:42:01 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:42:01 user nova-compute[75288]:     <system>
Nov 10 22:42:01 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:42:01 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:42:01 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:42:01 user nova-compute[75288]:       <entry name="serial">42be4921-aac5-4ee5-9564-455e9558ded0</entry>
Nov 10 22:42:01 user nova-compute[75288]:       <entry name="uuid">42be4921-aac5-4ee5-9564-455e9558ded0</entry>
Nov 10 22:42:01 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:42:01 user nova-compute[75288]:     </system>
Nov 10 22:42:01 user nova-compute[75288]:   </sysinfo>
Nov 10 22:42:01 user nova-compute[75288]:   <os>
Nov 10 22:42:01 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:42:01 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:42:01 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:42:01 user nova-compute[75288]:   </os>
Nov 10 22:42:01 user nova-compute[75288]:   <features>
Nov 10 22:42:01 user nova-compute[75288]:     <acpi/>
Nov 10 22:42:01 user nova-compute[75288]:     <apic/>
Nov 10 22:42:01 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:42:01 user nova-compute[75288]:   </features>
Nov 10 22:42:01 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:42:01 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:42:01 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:42:01 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:42:01 user nova-compute[75288]:   </clock>
Nov 10 22:42:01 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:42:01 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:42:01 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:42:01 user nova-compute[75288]:   </cpu>
Nov 10 22:42:01 user nova-compute[75288]:   <devices>
Nov 10 22:42:01 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:42:01 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:42:01 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk"/>
Nov 10 22:42:01 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:42:01 user nova-compute[75288]:     </disk>
Nov 10 22:42:01 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:42:01 user nova-compute[75288]:       <mac address="fa:16:3e:0b:1a:e4"/>
Nov 10 22:42:01 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:42:01 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:42:01 user nova-compute[75288]:       <target dev="tap004daad5-a7"/>
Nov 10 22:42:01 user nova-compute[75288]:     </interface>
Nov 10 22:42:01 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:42:01 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/console.log" append="off"/>
Nov 10 22:42:01 user nova-compute[75288]:     </serial>
Nov 10 22:42:01 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:42:01 user nova-compute[75288]:     <video>
Nov 10 22:42:01 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:42:01 user nova-compute[75288]:     </video>
Nov 10 22:42:01 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:42:01 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:42:01 user nova-compute[75288]:     </rng>
Nov 10 22:42:01 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:42:01 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:42:01 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:42:01 user nova-compute[75288]:     </memballoon>
Nov 10 22:42:01 user nova-compute[75288]:   </devices>
Nov 10 22:42:01 user nova-compute[75288]: </domain>
Nov 10 22:42:01 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-348158825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-348158825',id=19,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl3bnDr6iWD2rDxViaXHLOHvBAxs6kgwoH4KHi0DyqdB+X0ShLlFByhguU1fNi4/if+gomSn7bK/KT9k2KIha7W5cZLDZnZLRjdK9prTch89nrolMuTJz6JRNi6ZY3J9g==',key_name='tempest-keypair-276005353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-lihpwz8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=42be4921-aac5-4ee5-9564-455e9558ded0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG os_vif [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86e0e40f-b6f0-5da8-a608-8f40dd9e01c7', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap004daad5-a7, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap004daad5-a7, col_values=(('qos', UUID('448ccd55-e1b8-4a5a-992c-a5e536253183')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap004daad5-a7, col_values=(('external_ids', {'iface-id': '004daad5-a7a8-4929-8faf-aa904b1c2bb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:1a:e4', 'vm-uuid': '42be4921-aac5-4ee5-9564-455e9558ded0'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:02 user nova-compute[75288]: INFO os_vif [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7')
Nov 10 22:42:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No VIF found with MAC fa:16:3e:0b:1a:e4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updated VIF entry in instance network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:42:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e936f762-42cc-448c-b47e-fd53bef8e5e6 req-fe5b00f6-17e9-4e67-96b4-5387eb2b95c9 service nova] Releasing lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-3baa0778-4e92-4ecc-9996-48e282307021 req-d0c7bbcb-7b50-41cf-a5f9-39214045aea2 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3baa0778-4e92-4ecc-9996-48e282307021 req-d0c7bbcb-7b50-41cf-a5f9-39214045aea2 service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3baa0778-4e92-4ecc-9996-48e282307021 req-d0c7bbcb-7b50-41cf-a5f9-39214045aea2 service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3baa0778-4e92-4ecc-9996-48e282307021 req-d0c7bbcb-7b50-41cf-a5f9-39214045aea2 service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-3baa0778-4e92-4ecc-9996-48e282307021 req-d0c7bbcb-7b50-41cf-a5f9-39214045aea2 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:42:03 user nova-compute[75288]: WARNING nova.compute.manager [req-3baa0778-4e92-4ecc-9996-48e282307021 req-d0c7bbcb-7b50-41cf-a5f9-39214045aea2 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received unexpected event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with vm_state building and task_state spawning.
Nov 10 22:42:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-dc0e2f8a-752c-4c97-94b7-52106b50619f req-1f6492ef-c4af-40d2-be28-f89c2a65eefc service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dc0e2f8a-752c-4c97-94b7-52106b50619f req-1f6492ef-c4af-40d2-be28-f89c2a65eefc service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dc0e2f8a-752c-4c97-94b7-52106b50619f req-1f6492ef-c4af-40d2-be28-f89c2a65eefc service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dc0e2f8a-752c-4c97-94b7-52106b50619f req-1f6492ef-c4af-40d2-be28-f89c2a65eefc service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-dc0e2f8a-752c-4c97-94b7-52106b50619f req-1f6492ef-c4af-40d2-be28-f89c2a65eefc service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:42:06 user nova-compute[75288]: WARNING nova.compute.manager [req-dc0e2f8a-752c-4c97-94b7-52106b50619f req-1f6492ef-c4af-40d2-be28-f89c2a65eefc service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received unexpected event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with vm_state building and task_state spawning.
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:42:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance spawned successfully.
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:42:06 user nova-compute[75288]: INFO nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:06 user nova-compute[75288]: INFO nova.compute.manager [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Terminating instance
Nov 10 22:42:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:06 user nova-compute[75288]: INFO nova.compute.manager [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Took 7.19 seconds to build instance.
Nov 10 22:42:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dedd3bf0-da90-4572-bc74-9091fc7a936a tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.308s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-8417abe1-c6d1-4594-bccc-78b3afc63024 req-50f57c01-be71-425c-902d-e191d051915a service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-vif-unplugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8417abe1-c6d1-4594-bccc-78b3afc63024 req-50f57c01-be71-425c-902d-e191d051915a service nova] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8417abe1-c6d1-4594-bccc-78b3afc63024 req-50f57c01-be71-425c-902d-e191d051915a service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8417abe1-c6d1-4594-bccc-78b3afc63024 req-50f57c01-be71-425c-902d-e191d051915a service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-8417abe1-c6d1-4594-bccc-78b3afc63024 req-50f57c01-be71-425c-902d-e191d051915a service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] No waiting events found dispatching network-vif-unplugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-8417abe1-c6d1-4594-bccc-78b3afc63024 req-50f57c01-be71-425c-902d-e191d051915a service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-vif-unplugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:42:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 80788251-eb95-4022-8170-d219f083c64f] Instance destroyed successfully.
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lazy-loading 'resources' on Instance uuid 80788251-eb95-4022-8170-d219f083c64f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1709310066',display_name='tempest-VolumesAdminNegativeTest-server-1709310066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1709310066',id=7,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARaNJ2Q85Dq6STMwQ2qAyc+61Bi+oImbfRX6UEkYjPouffmPHIZOVfyyaRKvIJU2GToL16dOH0wObruYZfH0ILro1rtijf5ZIafH9UcXTXq9JJeugyyRx4da1jpL8zXXA==',key_name='tempest-keypair-1168477474',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:35:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70ddead166794fd4b660457f109f7bc3',ramdisk_id='',reservation_id='r-4k0sollv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1375484400',owner_user_name='tempest-VolumesAdminNegativeTest-1375484400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe464c9138840019ac3a32c3c9bcfab',uuid=80788251-eb95-4022-8170-d219f083c64f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converting VIF {"id": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "address": "fa:16:3e:35:65:5d", "network": {"id": "35ff7b6c-5969-4ab8-9ac6-f5862ac11b98", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1734249659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70ddead166794fd4b660457f109f7bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cdebbe-eb", "ovs_interfaceid": "56cdebbe-eb68-4d33-a733-a4af22ec7369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:65:5d,bridge_name='br-int',has_traffic_filtering=True,id=56cdebbe-eb68-4d33-a733-a4af22ec7369,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cdebbe-eb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG os_vif [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:65:5d,bridge_name='br-int',has_traffic_filtering=True,id=56cdebbe-eb68-4d33-a733-a4af22ec7369,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cdebbe-eb') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56cdebbe-eb, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3609198b-36d0-4057-aa80-e77091e35823) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:07 user nova-compute[75288]: INFO os_vif [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:65:5d,bridge_name='br-int',has_traffic_filtering=True,id=56cdebbe-eb68-4d33-a733-a4af22ec7369,network=Network(35ff7b6c-5969-4ab8-9ac6-f5862ac11b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cdebbe-eb')
Nov 10 22:42:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Deleting instance files /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f_del
Nov 10 22:42:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Deletion of /opt/stack/data/nova/instances/80788251-eb95-4022-8170-d219f083c64f_del complete
Nov 10 22:42:07 user nova-compute[75288]: INFO nova.compute.manager [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] [instance: 80788251-eb95-4022-8170-d219f083c64f] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 10 22:42:07 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 80788251-eb95-4022-8170-d219f083c64f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:42:07 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 80788251-eb95-4022-8170-d219f083c64f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:42:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:08 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 80788251-eb95-4022-8170-d219f083c64f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:42:08 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 80788251-eb95-4022-8170-d219f083c64f] Took 1.24 seconds to deallocate network for instance.
Nov 10 22:42:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-1089133b-dce7-4457-ae1b-e300297060ea req-139e4173-db6c-48f8-bcd3-fd7506d2481c service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-vif-deleted-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-dff32504-4f7b-491e-8e97-371b1c7e9685 req-632f6408-6aa0-4ffe-9c23-59fd90fc6e70 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received event network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dff32504-4f7b-491e-8e97-371b1c7e9685 req-632f6408-6aa0-4ffe-9c23-59fd90fc6e70 service nova] Acquiring lock "80788251-eb95-4022-8170-d219f083c64f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dff32504-4f7b-491e-8e97-371b1c7e9685 req-632f6408-6aa0-4ffe-9c23-59fd90fc6e70 service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dff32504-4f7b-491e-8e97-371b1c7e9685 req-632f6408-6aa0-4ffe-9c23-59fd90fc6e70 service nova] Lock "80788251-eb95-4022-8170-d219f083c64f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-dff32504-4f7b-491e-8e97-371b1c7e9685 req-632f6408-6aa0-4ffe-9c23-59fd90fc6e70 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] No waiting events found dispatching network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:42:09 user nova-compute[75288]: WARNING nova.compute.manager [req-dff32504-4f7b-491e-8e97-371b1c7e9685 req-632f6408-6aa0-4ffe-9c23-59fd90fc6e70 service nova] [instance: 80788251-eb95-4022-8170-d219f083c64f] Received unexpected event network-vif-plugged-56cdebbe-eb68-4d33-a733-a4af22ec7369 for instance with vm_state deleted and task_state None.
Nov 10 22:42:09 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.607s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:09 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Deleted allocations for instance 80788251-eb95-4022-8170-d219f083c64f
Nov 10 22:42:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c3a2b3bd-312f-4b35-bc42-9f66418ff064 tempest-VolumesAdminNegativeTest-1375484400 tempest-VolumesAdminNegativeTest-1375484400-project-member] Lock "80788251-eb95-4022-8170-d219f083c64f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.180s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:42:10 user nova-compute[75288]: INFO nova.compute.claims [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Claim successful on node user
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:42:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:42:10 user nova-compute[75288]: DEBUG nova.policy [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07d1ae0425e64057b3b2220d4bb02624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4325393aa3434c2a87912895d4574812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:42:10 user nova-compute[75288]: INFO nova.virt.block_device [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Booting with volume-backed-image f7c29f6c-dbb5-44ff-8be6-262881085121 at /dev/vda
Nov 10 22:42:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Successfully created port: a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Successfully updated port: a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquired lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-changed-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Refreshing instance network info cache due to event network-changed-a5dd02b7-0e66-4753-adbc-5ac057ce4fad. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] Acquiring lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:42:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updating instance_info_cache with network_info: [{"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Releasing lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance network_info: |[{"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] Acquired lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Refreshing network info cache for port a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updated VIF entry in instance network info cache for port a5dd02b7-0e66-4753-adbc-5ac057ce4fad. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updating instance_info_cache with network_info: [{"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:42:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-38666aa4-97a9-4b86-99c2-a12b2e064520 req-49965805-24bc-4770-927b-d784fc517beb service nova] Releasing lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:42:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:42:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:42:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:42:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:42:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7681MB free_disk=25.355690002441406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5bce81d0-809c-4c80-8740-c0277d7a290d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 42be4921-aac5-4ee5-9564-455e9558ded0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:42:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:42:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG os_brick.utils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebdc2b8-12cb-402c-b3a8-00e59a3e4de9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc4303c-88a9-4e4a-b64c-0523d635651d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f76f8-cb75-4ac1-b6f6-49cc4d0904ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b77a8-afd6-4978-a3e2-4570d340e360]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:42:32 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:42:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc7a16-cc37-472e-a00f-7ec326ed8a62]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG os_brick.utils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updating existing volume attachment record: 4f27f930-8bb5-4a11-b1a8-bdd78c6b4bc2 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:42:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:42:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Creating image(s)
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Ensure instance console log exists: /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Start _get_guest_xml network_info=[{"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMIyhDRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b99fd44-d683-43c8-9de4-1cc73e15cc9f', 'attached_at': '', 'detached_at': '', 'volume_id': '9dae92f4-19fc-4363-8255-72bb93d68bda', 'serial': '9dae92f4-19fc-4363-8255-72bb93d68bda'}, 'mount_device': '/dev/vda', 'attachment_id': '4f27f930-8bb5-4a11-b1a8-bdd78c6b4bc2', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:42:56 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:42:56 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMIyhDRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:42:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:42:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:42:56 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e27be40-314a-412d-bf12-6de0046bbc42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:42:56 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[53939e6f-24ac-47ad-b8f8-99dc2233b13e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda] added
Nov 10 22:42:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbca058-b97c-4375-bd5d-31f1fcc64a15]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ccc3f4-df5c-4013-a5cd-367261814bd5]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMIyhDRs {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMIyhDRs" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cf90fb-17ee-4caa-90bc-7fb5b4e9d1ce]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NMIyhDRs'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a4b6c1-d6c6-49ae-a83b-e76319ec380a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8792c237-e0aa-490a-ae48-ac6fc75ee7b2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:42:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:42:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e8e988-4742-4164-89bf-6183011d2d75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260]
Nov 10 22:42:56 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260] successful.
Nov 10 22:42:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0034ceb6-4c67-4180-b858-c79d013d10ed]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c77bea-bb68-4a24-961a-5f1f95b65982]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:42:56 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:42:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:42:56 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:42:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6820817-f741-481e-94be-dd96e5feb598]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:42:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMIyhDRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-changed-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Refreshing instance network info cache due to event network-changed-c1696001-71da-4a44-b142-02f5e0248e99. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] Acquiring lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] Acquired lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Refreshing network info cache for port c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23861376333356431', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861376333356431', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-827809454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-827809454',id=20,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-1otxj820',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:42:11Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=7b99fd44-d683-43c8-9de4-1cc73e15cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:42:57 user nova-compute[75288]:   <uuid>7b99fd44-d683-43c8-9de4-1cc73e15cc9f</uuid>
Nov 10 22:42:57 user nova-compute[75288]:   <name>instance-00000014</name>
Nov 10 22:42:57 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:42:57 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:42:57 user nova-compute[75288]:   <metadata>
Nov 10 22:42:57 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:42:57 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:42:57 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-827809454</nova:name>
Nov 10 22:42:57 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:42:56</nova:creationTime>
Nov 10 22:42:57 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:42:57 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:42:57 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:42:57 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:42:57 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:42:57 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:42:57 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:42:57 user nova-compute[75288]:       <nova:owner>
Nov 10 22:42:57 user nova-compute[75288]:         <nova:user uuid="07d1ae0425e64057b3b2220d4bb02624">tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member</nova:user>
Nov 10 22:42:57 user nova-compute[75288]:         <nova:project uuid="4325393aa3434c2a87912895d4574812">tempest-ServerBootFromVolumeStableRescueTest-244383607</nova:project>
Nov 10 22:42:57 user nova-compute[75288]:       </nova:owner>
Nov 10 22:42:57 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:42:57 user nova-compute[75288]:       <nova:ports>
Nov 10 22:42:57 user nova-compute[75288]:         <nova:port uuid="a5dd02b7-0e66-4753-adbc-5ac057ce4fad">
Nov 10 22:42:57 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 22:42:57 user nova-compute[75288]:         </nova:port>
Nov 10 22:42:57 user nova-compute[75288]:       </nova:ports>
Nov 10 22:42:57 user nova-compute[75288]:     </nova:instance>
Nov 10 22:42:57 user nova-compute[75288]:   </metadata>
Nov 10 22:42:57 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:42:57 user nova-compute[75288]:     <system>
Nov 10 22:42:57 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:42:57 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:42:57 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:42:57 user nova-compute[75288]:       <entry name="serial">7b99fd44-d683-43c8-9de4-1cc73e15cc9f</entry>
Nov 10 22:42:57 user nova-compute[75288]:       <entry name="uuid">7b99fd44-d683-43c8-9de4-1cc73e15cc9f</entry>
Nov 10 22:42:57 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:42:57 user nova-compute[75288]:     </system>
Nov 10 22:42:57 user nova-compute[75288]:   </sysinfo>
Nov 10 22:42:57 user nova-compute[75288]:   <os>
Nov 10 22:42:57 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:42:57 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:42:57 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:42:57 user nova-compute[75288]:   </os>
Nov 10 22:42:57 user nova-compute[75288]:   <features>
Nov 10 22:42:57 user nova-compute[75288]:     <acpi/>
Nov 10 22:42:57 user nova-compute[75288]:     <apic/>
Nov 10 22:42:57 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:42:57 user nova-compute[75288]:   </features>
Nov 10 22:42:57 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:42:57 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:42:57 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:42:57 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:42:57 user nova-compute[75288]:   </clock>
Nov 10 22:42:57 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:42:57 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:42:57 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:42:57 user nova-compute[75288]:   </cpu>
Nov 10 22:42:57 user nova-compute[75288]:   <devices>
Nov 10 22:42:57 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:42:57 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:42:57 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Nov 10 22:42:57 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:42:57 user nova-compute[75288]:       <serial>9dae92f4-19fc-4363-8255-72bb93d68bda</serial>
Nov 10 22:42:57 user nova-compute[75288]:     </disk>
Nov 10 22:42:57 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:42:57 user nova-compute[75288]:       <mac address="fa:16:3e:ef:23:84"/>
Nov 10 22:42:57 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:42:57 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:42:57 user nova-compute[75288]:       <target dev="tapa5dd02b7-0e"/>
Nov 10 22:42:57 user nova-compute[75288]:     </interface>
Nov 10 22:42:57 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:42:57 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/console.log" append="off"/>
Nov 10 22:42:57 user nova-compute[75288]:     </serial>
Nov 10 22:42:57 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:42:57 user nova-compute[75288]:     <video>
Nov 10 22:42:57 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:42:57 user nova-compute[75288]:     </video>
Nov 10 22:42:57 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:42:57 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:42:57 user nova-compute[75288]:     </rng>
Nov 10 22:42:57 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:42:57 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:42:57 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:42:57 user nova-compute[75288]:     </memballoon>
Nov 10 22:42:57 user nova-compute[75288]:   </devices>
Nov 10 22:42:57 user nova-compute[75288]: </domain>
Nov 10 22:42:57 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-827809454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-827809454',id=20,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-1otxj820',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:42:11Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=7b99fd44-d683-43c8-9de4-1cc73e15cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG os_vif [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecb0addb-6b5e-55a7-b1a7-ddde3f21f1e4', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:42:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5dd02b7-0e, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5dd02b7-0e, col_values=(('qos', UUID('a7a720a6-b294-4ee2-8ea8-6811fad2dd11')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5dd02b7-0e, col_values=(('external_ids', {'iface-id': 'a5dd02b7-0e66-4753-adbc-5ac057ce4fad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:23:84', 'vm-uuid': '7b99fd44-d683-43c8-9de4-1cc73e15cc9f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:58 user nova-compute[75288]: INFO os_vif [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e')
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lazy-loading 'flavor' on Instance uuid 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No VIF found with MAC fa:16:3e:ef:23:84, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:42:58 user nova-compute[75288]: INFO nova.compute.manager [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Attaching volume 82fccb8c-c07d-447d-bc1f-85b71991ec14 to /dev/vdb
Nov 10 22:42:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Updated VIF entry in instance network info cache for port c1696001-71da-4a44-b142-02f5e0248e99. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Updating instance_info_cache with network_info: [{"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG os_brick.utils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2688d27-323a-4d51-ae97-ae418af9baea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d318581b-dcae-41d0-b97d-5308b93eea8e req-2fedbaec-d561-4a5b-935c-8c379197db39 service nova] Releasing lock "refresh_cache-5bce81d0-809c-4c80-8740-c0277d7a290d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c3f099-1aeb-407a-854d-9a3ea0d5c9f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69efd53-d644-4383-bece-58e57f2dcb51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a26dc9-ca23-43f2-8221-03edf8614970]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:42:58 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:42:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[523a6876-2eb8-4f76-991a-7900200115b2]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG os_brick.utils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:42:58 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Updating existing volume attachment record: 4d9d77d4-ca0d-48e6-a7a1-22f3219b85c4 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:42:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:42:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-af33ef22-282e-43c5-8347-1ff780a2e3b3 req-4155e5db-2e5c-401b-9eff-f0f82e69b6d2 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af33ef22-282e-43c5-8347-1ff780a2e3b3 req-4155e5db-2e5c-401b-9eff-f0f82e69b6d2 service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af33ef22-282e-43c5-8347-1ff780a2e3b3 req-4155e5db-2e5c-401b-9eff-f0f82e69b6d2 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af33ef22-282e-43c5-8347-1ff780a2e3b3 req-4155e5db-2e5c-401b-9eff-f0f82e69b6d2 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-af33ef22-282e-43c5-8347-1ff780a2e3b3 req-4155e5db-2e5c-401b-9eff-f0f82e69b6d2 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:43:00 user nova-compute[75288]: WARNING nova.compute.manager [req-af33ef22-282e-43c5-8347-1ff780a2e3b3 req-4155e5db-2e5c-401b-9eff-f0f82e69b6d2 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state building and task_state spawning.
Nov 10 22:43:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:43:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:43:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance spawned successfully.
Nov 10 22:43:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1c2795e6-74ab-47d9-ae4a-d7fe2c5136bf req-37f8791b-f775-4c34-b6b4-3161bcaef1fb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1c2795e6-74ab-47d9-ae4a-d7fe2c5136bf req-37f8791b-f775-4c34-b6b4-3161bcaef1fb service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1c2795e6-74ab-47d9-ae4a-d7fe2c5136bf req-37f8791b-f775-4c34-b6b4-3161bcaef1fb service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1c2795e6-74ab-47d9-ae4a-d7fe2c5136bf req-37f8791b-f775-4c34-b6b4-3161bcaef1fb service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1c2795e6-74ab-47d9-ae4a-d7fe2c5136bf req-37f8791b-f775-4c34-b6b4-3161bcaef1fb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:43:02 user nova-compute[75288]: WARNING nova.compute.manager [req-1c2795e6-74ab-47d9-ae4a-d7fe2c5136bf req-37f8791b-f775-4c34-b6b4-3161bcaef1fb service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state building and task_state spawning.
Nov 10 22:43:02 user nova-compute[75288]: INFO nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 10 22:43:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:43:02 user nova-compute[75288]: INFO nova.compute.manager [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Took 52.06 seconds to build instance.
Nov 10 22:43:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a04354b1-2bf2-439e-9778-621933fdf676 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.475s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'flavor' on Instance uuid 70c0e693-25bf-45bb-80b8-a3829e58a067 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:03 user nova-compute[75288]: INFO nova.compute.manager [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Attaching volume 480f38c3-0d0f-455f-b563-271a29ed66f7 to /dev/vdb
Nov 10 22:43:04 user nova-compute[75288]: DEBUG os_brick.utils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2059697c-6628-438d-ae94-1bf95893b7be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-changed-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Refreshing instance network info cache due to event network-changed-7ed0c9fb-6897-425d-8c29-ba63bfd452d6. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] Acquiring lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] Acquired lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Refreshing network info cache for port 7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc1606e-1c9f-48ff-8072-70d1e1b3f875]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d91f1-f3c2-4baf-a6b3-3780affa27b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b6e5f-92cb-412c-8026-f3eb83bd13c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:43:04 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[326fe753-7f3c-4021-b260-1f44af358823]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG os_brick.utils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updating existing volume attachment record: 45f124c5-d370-4771-a06c-1bedd21456cf {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updated VIF entry in instance network info cache for port 7ed0c9fb-6897-425d-8c29-ba63bfd452d6. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updating instance_info_cache with network_info: [{"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:43:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a7082c03-47f4-4ffa-b93e-fb9fb3bd422b req-e248a504-06db-48e2-baf0-5e6d2e890089 service nova] Releasing lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:43:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:10 user nova-compute[75288]: INFO nova.compute.manager [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Detaching volume 98e750ca-649c-455e-8880-fc1d2804501e
Nov 10 22:43:10 user nova-compute[75288]: INFO nova.virt.block_device [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Attempting to driver detach volume 98e750ca-649c-455e-8880-fc1d2804501e from mountpoint /dev/vdb
Nov 10 22:43:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Attempting to detach device vdb from instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:43:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:43:10 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:43:10 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:43:10 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:43:10 user nova-compute[75288]:   <serial>98e750ca-649c-455e-8880-fc1d2804501e</serial>
Nov 10 22:43:10 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:43:10 user nova-compute[75288]: </disk>
Nov 10 22:43:10 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:43:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully detached device vdb from instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf from the persistent domain config.
Nov 10 22:43:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:43:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:43:10 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:43:10 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:43:10 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:43:10 user nova-compute[75288]:   <serial>98e750ca-649c-455e-8880-fc1d2804501e</serial>
Nov 10 22:43:10 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:43:10 user nova-compute[75288]: </disk>
Nov 10 22:43:10 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:43:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:43:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "57a2b622-7db5-47f7-a51e-b3544b898306" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:43:17 user nova-compute[75288]: INFO nova.compute.claims [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Claim successful on node user
Nov 10 22:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:43:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:43:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Creating image(s)
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "/opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "/opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "/opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG nova.policy [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1b51c6d64044e57b9afcc85619c88e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef52a00aba2b48d5904eda97ecc89861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk 1073741824" returned: 0 in 0.053s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Successfully created port: 85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Cannot resize image /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Ensure instance console log exists: /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Successfully updated port: 85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquired lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-changed-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Refreshing instance network info cache due to event network-changed-85f3d62a-91b8-4568-9434-06340e81c824. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] Acquiring lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:43:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Updating instance_info_cache with network_info: [{"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Releasing lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Instance network_info: |[{"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] Acquired lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Refreshing network info cache for port 85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Start _get_guest_xml network_info=[{"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:43:21 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:43:21 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-439242538',display_name='tempest-ServersNegativeTestJSON-server-439242538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-439242538',id=21,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef52a00aba2b48d5904eda97ecc89861',ramdisk_id='',reservation_id='r-4faeqt0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-891085347',owner_user_name='tempest-ServersNegativeTestJSON-891085347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:43:18Z,user_data=None,user_id='b1b51c6d64044e57b9afcc85619c88e6',uuid=57a2b622-7db5-47f7-a51e-b3544b898306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converting VIF {"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:1e,bridge_name='br-int',has_traffic_filtering=True,id=85f3d62a-91b8-4568-9434-06340e81c824,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f3d62a-91') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lazy-loading 'pci_devices' on Instance uuid 57a2b622-7db5-47f7-a51e-b3544b898306 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:43:21 user nova-compute[75288]:   <uuid>57a2b622-7db5-47f7-a51e-b3544b898306</uuid>
Nov 10 22:43:21 user nova-compute[75288]:   <name>instance-00000015</name>
Nov 10 22:43:21 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:43:21 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:43:21 user nova-compute[75288]:   <metadata>
Nov 10 22:43:21 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:43:21 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:43:21 user nova-compute[75288]:       <nova:name>tempest-ServersNegativeTestJSON-server-439242538</nova:name>
Nov 10 22:43:21 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:43:21</nova:creationTime>
Nov 10 22:43:21 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:43:21 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:43:21 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:43:21 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:43:21 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:43:21 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:43:21 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:43:21 user nova-compute[75288]:       <nova:owner>
Nov 10 22:43:21 user nova-compute[75288]:         <nova:user uuid="b1b51c6d64044e57b9afcc85619c88e6">tempest-ServersNegativeTestJSON-891085347-project-member</nova:user>
Nov 10 22:43:21 user nova-compute[75288]:         <nova:project uuid="ef52a00aba2b48d5904eda97ecc89861">tempest-ServersNegativeTestJSON-891085347</nova:project>
Nov 10 22:43:21 user nova-compute[75288]:       </nova:owner>
Nov 10 22:43:21 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:43:21 user nova-compute[75288]:       <nova:ports>
Nov 10 22:43:21 user nova-compute[75288]:         <nova:port uuid="85f3d62a-91b8-4568-9434-06340e81c824">
Nov 10 22:43:21 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 22:43:21 user nova-compute[75288]:         </nova:port>
Nov 10 22:43:21 user nova-compute[75288]:       </nova:ports>
Nov 10 22:43:21 user nova-compute[75288]:     </nova:instance>
Nov 10 22:43:21 user nova-compute[75288]:   </metadata>
Nov 10 22:43:21 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:43:21 user nova-compute[75288]:     <system>
Nov 10 22:43:21 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:43:21 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:43:21 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:43:21 user nova-compute[75288]:       <entry name="serial">57a2b622-7db5-47f7-a51e-b3544b898306</entry>
Nov 10 22:43:21 user nova-compute[75288]:       <entry name="uuid">57a2b622-7db5-47f7-a51e-b3544b898306</entry>
Nov 10 22:43:21 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:43:21 user nova-compute[75288]:     </system>
Nov 10 22:43:21 user nova-compute[75288]:   </sysinfo>
Nov 10 22:43:21 user nova-compute[75288]:   <os>
Nov 10 22:43:21 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:43:21 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:43:21 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:43:21 user nova-compute[75288]:   </os>
Nov 10 22:43:21 user nova-compute[75288]:   <features>
Nov 10 22:43:21 user nova-compute[75288]:     <acpi/>
Nov 10 22:43:21 user nova-compute[75288]:     <apic/>
Nov 10 22:43:21 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:43:21 user nova-compute[75288]:   </features>
Nov 10 22:43:21 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:43:21 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:43:21 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:43:21 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:43:21 user nova-compute[75288]:   </clock>
Nov 10 22:43:21 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:43:21 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:43:21 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:43:21 user nova-compute[75288]:   </cpu>
Nov 10 22:43:21 user nova-compute[75288]:   <devices>
Nov 10 22:43:21 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:43:21 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:43:21 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk"/>
Nov 10 22:43:21 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:43:21 user nova-compute[75288]:     </disk>
Nov 10 22:43:21 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:43:21 user nova-compute[75288]:       <mac address="fa:16:3e:54:44:1e"/>
Nov 10 22:43:21 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:43:21 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:43:21 user nova-compute[75288]:       <target dev="tap85f3d62a-91"/>
Nov 10 22:43:21 user nova-compute[75288]:     </interface>
Nov 10 22:43:21 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:43:21 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/console.log" append="off"/>
Nov 10 22:43:21 user nova-compute[75288]:     </serial>
Nov 10 22:43:21 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:43:21 user nova-compute[75288]:     <video>
Nov 10 22:43:21 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:43:21 user nova-compute[75288]:     </video>
Nov 10 22:43:21 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:43:21 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:43:21 user nova-compute[75288]:     </rng>
Nov 10 22:43:21 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:43:21 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:43:21 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:43:21 user nova-compute[75288]:     </memballoon>
Nov 10 22:43:21 user nova-compute[75288]:   </devices>
Nov 10 22:43:21 user nova-compute[75288]: </domain>
Nov 10 22:43:21 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-439242538',display_name='tempest-ServersNegativeTestJSON-server-439242538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-439242538',id=21,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef52a00aba2b48d5904eda97ecc89861',ramdisk_id='',reservation_id='r-4faeqt0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-891085347',owner_user_name='tempest-ServersNegativeTestJSON-891085347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:43:18Z,user_data=None,user_id='b1b51c6d64044e57b9afcc85619c88e6',uuid=57a2b622-7db5-47f7-a51e-b3544b898306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converting VIF {"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:1e,bridge_name='br-int',has_traffic_filtering=True,id=85f3d62a-91b8-4568-9434-06340e81c824,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f3d62a-91') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG os_vif [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:1e,bridge_name='br-int',has_traffic_filtering=True,id=85f3d62a-91b8-4568-9434-06340e81c824,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f3d62a-91') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a12a9cac-05fa-5875-bc60-0d0aeb6e00d9', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85f3d62a-91, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85f3d62a-91, col_values=(('qos', UUID('d0fcb289-b411-4ea5-a630-a6fecbf8d409')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85f3d62a-91, col_values=(('external_ids', {'iface-id': '85f3d62a-91b8-4568-9434-06340e81c824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:44:1e', 'vm-uuid': '57a2b622-7db5-47f7-a51e-b3544b898306'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:21 user nova-compute[75288]: INFO os_vif [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:1e,bridge_name='br-int',has_traffic_filtering=True,id=85f3d62a-91b8-4568-9434-06340e81c824,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f3d62a-91')
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] No VIF found with MAC fa:16:3e:54:44:1e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updating instance_info_cache with network_info: [{"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-f9c056b7-56a6-4dd9-972b-7290c27c8fcf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Updated VIF entry in instance network info cache for port 85f3d62a-91b8-4568-9434-06340e81c824. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Updating instance_info_cache with network_info: [{"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:43:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8305e861-3988-4be1-b376-a9fd05967b48 req-b5da8a24-6932-4f59-b493-b9ccd6383b83 service nova] Releasing lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:43:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a2c3ea3-cdcf-4535-885c-771d4d1665ba req-6d3bfe65-2c7b-4a9c-8d57-0a1285503fc4 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a2c3ea3-cdcf-4535-885c-771d4d1665ba req-6d3bfe65-2c7b-4a9c-8d57-0a1285503fc4 service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a2c3ea3-cdcf-4535-885c-771d4d1665ba req-6d3bfe65-2c7b-4a9c-8d57-0a1285503fc4 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a2c3ea3-cdcf-4535-885c-771d4d1665ba req-6d3bfe65-2c7b-4a9c-8d57-0a1285503fc4 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a2c3ea3-cdcf-4535-885c-771d4d1665ba req-6d3bfe65-2c7b-4a9c-8d57-0a1285503fc4 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:43:23 user nova-compute[75288]: WARNING nova.compute.manager [req-3a2c3ea3-cdcf-4535-885c-771d4d1665ba req-6d3bfe65-2c7b-4a9c-8d57-0a1285503fc4 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received unexpected event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with vm_state building and task_state spawning.
Nov 10 22:43:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-c6ea2983-b858-48f5-bd6e-bac52443dbe4 req-e25c7a49-e90e-4a12-9c9e-7924eb614a78 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c6ea2983-b858-48f5-bd6e-bac52443dbe4 req-e25c7a49-e90e-4a12-9c9e-7924eb614a78 service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c6ea2983-b858-48f5-bd6e-bac52443dbe4 req-e25c7a49-e90e-4a12-9c9e-7924eb614a78 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c6ea2983-b858-48f5-bd6e-bac52443dbe4 req-e25c7a49-e90e-4a12-9c9e-7924eb614a78 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-c6ea2983-b858-48f5-bd6e-bac52443dbe4 req-e25c7a49-e90e-4a12-9c9e-7924eb614a78 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:43:25 user nova-compute[75288]: WARNING nova.compute.manager [req-c6ea2983-b858-48f5-bd6e-bac52443dbe4 req-e25c7a49-e90e-4a12-9c9e-7924eb614a78 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received unexpected event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with vm_state building and task_state spawning.
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:43:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Instance spawned successfully.
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:25 user nova-compute[75288]: INFO nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Took 7.02 seconds to spawn the instance on the hypervisor.
Nov 10 22:43:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:43:25 user nova-compute[75288]: INFO nova.compute.manager [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Took 7.93 seconds to build instance.
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5fead58d-acef-4f76-99f2-232809400afc tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "57a2b622-7db5-47f7-a51e-b3544b898306" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.060s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:43:27 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:43:27 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:43:27 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[46110a10-1d41-4fda-b5ab-8777635b7af3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:43:27 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7597e24-b2c7-4f97-bbb7-81c3817167d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14] added
Nov 10 22:43:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db43137-8d07-4979-aea1-76a531ce71c5]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[de459855-b9d6-4719-919e-3d69b9089ae8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyetphaS {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyetphaS" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8aeff-4b5b-497f-b3db-802d5173ac9c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LyetphaS'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9bc5a-7450-4d0c-8b5f-e6eef88d3bd9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f2b0f-7b2c-4020-b2f3-35426078304c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:43:27 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:43:27 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac3b52b-b4c3-4c71-b3e3-0cb85fc0d297]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]
Nov 10 22:43:27 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.
Nov 10 22:43:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e413e1cc-3c12-4ea3-990b-f86105655c70]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd180cc1-b1ec-4130-b1b2-7dcd5dc77eb7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:43:27 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:27 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:43:27 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:27 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.034s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05741153-edd3-4e29-bc68-5ae42255a527]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:43:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7564MB free_disk=25.3397216796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23330383032346466', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330383032346466', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lazy-loading 'flavor' on Instance uuid 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:43:28 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:43:28 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:43:28 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:43:28 user nova-compute[75288]:   <serial>82fccb8c-c07d-447d-bc1f-85b71991ec14</serial>
Nov 10 22:43:28 user nova-compute[75288]: </disk>
Nov 10 22:43:28 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5bce81d0-809c-4c80-8740-c0277d7a290d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 42be4921-aac5-4ee5-9564-455e9558ded0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:43:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] No VIF found with MAC fa:16:3e:11:29:ea, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.911s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:43:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88a4c6d4-4427-4e06-9b13-11bceea6ef59 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.346s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[700d2c13-a32b-4835-a955-0528ba81da91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a766ae9-d740-46ad-a504-8626adf8f991]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988ec25-25f0-462f-a07d-d8cb0b3426cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b3ec08-2012-48c0-87a8-ee69dd17d349]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:43:30 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:43:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fc789b-3ddb-42b9-97e7-33ff48a00f81]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:43:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:43:31 user nova-compute[75288]: INFO nova.compute.manager [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Swapping volume 82fccb8c-c07d-447d-bc1f-85b71991ec14 for 382b1889-1dfe-4beb-a15c-c1848b180a3f
Nov 10 22:43:31 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf is timed out.
Nov 10 22:43:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully detached device vdb from instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf from the live domain config.
Nov 10 22:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilnGPsVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:43:31 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[153810b9-9778-44fa-9a5e-d496e20eeb0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:43:31 user nova-compute[75288]: No targets found.
Nov 10 22:43:31 user nova-compute[75288]: iSNS:
Nov 10 22:43:31 user nova-compute[75288]: No targets found.
Nov 10 22:43:31 user nova-compute[75288]: STATIC:
Nov 10 22:43:31 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:43:31 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:43:31 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:43:31 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e
Nov 10 22:43:31 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:43:31 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:43:31 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14
Nov 10 22:43:31 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:43:31 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:43:31 user nova-compute[75288]: FIRMWARE:
Nov 10 22:43:31 user nova-compute[75288]: No targets found.
Nov 10 22:43:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:43:31 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:43:31 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e24b1af-749b-4d92-ac2c-60c2673a3fef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7804750-2ca0-4242-bf8f-c08c32a449c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:43:31 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:31 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e (non-flash)
Nov 10 22:43:31 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:31 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b283e1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6c32ac-672a-4e29-a1d5-87fd3ec47778]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bf0b5e-34a0-4c8c-af80-c8f9858537ef]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2419239-6845-41e9-ac77-e37d348a7085]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f03125d-078e-42a7-a5c5-5d778487a74e]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dafa4a-23c0-44e3-8499-154ad3f72ad1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278f488-d297-4feb-94c4-e028efc82323]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260]
Nov 10 22:43:31 user nova-compute[75288]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e, portal: 172.16.0.220,3260] successful.
Nov 10 22:43:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e750ca-649c-455e-8880-fc1d2804501e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10641de-df8b-4548-882e-76eda7250c23]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== disconnect_volume: return (348ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:43:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:43:32 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'flavor' on Instance uuid f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3ddfca6d-033f-47e8-823f-bfc0aa8456f4 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.219s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXTlPuNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:43:34 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:43:34 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:43:34 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca2907-57cd-4d50-bd6a-b9562acf6b6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:43:34 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8f6bd-58fb-46e8-a70b-eb086be27aaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7] added
Nov 10 22:43:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2223232-44ee-4cc1-9c60-3fb0c4fdc7bc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c006fcc4-ef7d-4c85-9a2d-eda09355af65]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXTlPuNv {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXTlPuNv" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[47316852-8d50-4e16-8a86-f2c702ca072b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXTlPuNv'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec25c96-974a-4283-8b43-4ed04dd5a9b1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc5997-d537-4e85-8e93-119ce9cd61f3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:34 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:34 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea414979-582d-45f0-8ecb-067a88423e3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260]
Nov 10 22:43:34 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260] successful.
Nov 10 22:43:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d539e-8d12-4a4b-bca2-04870780171a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbae6c9-8fde-49fa-ad7e-d881a6f703a2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:34 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:34 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 (non-flash)
Nov 10 22:43:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:43:34 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:43:34 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 (non-flash)
Nov 10 22:43:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c018545-9651-4e4f-a146-96409ed6de55]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:43:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXTlPuNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lazy-loading 'flavor' on Instance uuid b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23238643538386239', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238643538386239', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'flavor' on Instance uuid 70c0e693-25bf-45bb-80b8-a3829e58a067 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:43:35 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:43:35 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:43:35 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:43:35 user nova-compute[75288]:   <serial>480f38c3-0d0f-455f-b563-271a29ed66f7</serial>
Nov 10 22:43:35 user nova-compute[75288]: </disk>
Nov 10 22:43:35 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:35 user nova-compute[75288]: INFO nova.compute.manager [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Attaching volume 4f3faf58-a34d-4eb7-b3cc-8ecd91584420 to /dev/vdb
Nov 10 22:43:35 user nova-compute[75288]: DEBUG os_brick.utils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f694a9-ffc4-4ada-9a2d-73ca8a4fc68c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d3f5c-17c5-42e5-8bda-76a433a5bc0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbb18ed-a7e6-4be5-953a-166bfbe1ade6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[143fc216-1281-48a6-b761-d2c1cfa8d162]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:43:36 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c566127-4011-473c-8c57-066d02aa4c66]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG os_brick.utils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating existing volume attachment record: 26c43112-57ef-4e2f-b87f-99f6f37b9eeb {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No VIF found with MAC fa:16:3e:bc:39:04, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3216e16b-b88a-4359-8449-4fa1c3d1bbf1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.821s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:40 user nova-compute[75288]: INFO nova.compute.manager [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Detaching volume 480f38c3-0d0f-455f-b563-271a29ed66f7
Nov 10 22:43:40 user nova-compute[75288]: INFO nova.virt.block_device [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Attempting to driver detach volume 480f38c3-0d0f-455f-b563-271a29ed66f7 from mountpoint /dev/vdb
Nov 10 22:43:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Attempting to detach device vdb from instance 70c0e693-25bf-45bb-80b8-a3829e58a067 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:43:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:43:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:43:40 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:43:40 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:43:40 user nova-compute[75288]:   <serial>480f38c3-0d0f-455f-b563-271a29ed66f7</serial>
Nov 10 22:43:40 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:43:40 user nova-compute[75288]: </disk>
Nov 10 22:43:40 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:43:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully detached device vdb from instance 70c0e693-25bf-45bb-80b8-a3829e58a067 from the persistent domain config.
Nov 10 22:43:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70c0e693-25bf-45bb-80b8-a3829e58a067 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:43:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:43:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:43:40 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:43:40 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:43:40 user nova-compute[75288]:   <serial>480f38c3-0d0f-455f-b563-271a29ed66f7</serial>
Nov 10 22:43:40 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:43:40 user nova-compute[75288]: </disk>
Nov 10 22:43:40 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:43:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70c0e693-25bf-45bb-80b8-a3829e58a067 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:43:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquired lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'info_cache' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG nova.objects.base [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Releasing lock "refresh_cache-33ebbf72-0319-4e06-af0c-cf1462053666" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:43:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance destroyed successfully.
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'resources' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.base [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG os_vif [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa17af079-be, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1ac47c1-c5ff-471a-993f-4b6f90b0d1e4) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:43:48 user nova-compute[75288]: INFO os_vif [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be')
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Start _get_guest_xml network_info=[{"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'numa_topology' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.base [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:43:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:43:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.base [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'pci_devices' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.base [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:43:48 user nova-compute[75288]:   <uuid>33ebbf72-0319-4e06-af0c-cf1462053666</uuid>
Nov 10 22:43:48 user nova-compute[75288]:   <name>instance-00000005</name>
Nov 10 22:43:48 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:43:48 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:43:48 user nova-compute[75288]:   <metadata>
Nov 10 22:43:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:43:48 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:43:48 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-1953048792</nova:name>
Nov 10 22:43:48 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:43:48</nova:creationTime>
Nov 10 22:43:48 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:43:48 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:43:48 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:43:48 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:43:48 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:43:48 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:43:48 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:43:48 user nova-compute[75288]:       <nova:owner>
Nov 10 22:43:48 user nova-compute[75288]:         <nova:user uuid="7f6b930fa714405192e875eaf51cff95">tempest-AttachVolumeTestJSON-979908124-project-member</nova:user>
Nov 10 22:43:48 user nova-compute[75288]:         <nova:project uuid="28bbf495a59c4f24945da89346c71dff">tempest-AttachVolumeTestJSON-979908124</nova:project>
Nov 10 22:43:48 user nova-compute[75288]:       </nova:owner>
Nov 10 22:43:48 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:43:48 user nova-compute[75288]:       <nova:ports>
Nov 10 22:43:48 user nova-compute[75288]:         <nova:port uuid="a17af079-be58-40cc-a993-4d5304f20445">
Nov 10 22:43:48 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 22:43:48 user nova-compute[75288]:         </nova:port>
Nov 10 22:43:48 user nova-compute[75288]:       </nova:ports>
Nov 10 22:43:48 user nova-compute[75288]:     </nova:instance>
Nov 10 22:43:48 user nova-compute[75288]:   </metadata>
Nov 10 22:43:48 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:43:48 user nova-compute[75288]:     <system>
Nov 10 22:43:48 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:43:48 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:43:48 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:43:48 user nova-compute[75288]:       <entry name="serial">33ebbf72-0319-4e06-af0c-cf1462053666</entry>
Nov 10 22:43:48 user nova-compute[75288]:       <entry name="uuid">33ebbf72-0319-4e06-af0c-cf1462053666</entry>
Nov 10 22:43:48 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:43:48 user nova-compute[75288]:     </system>
Nov 10 22:43:48 user nova-compute[75288]:   </sysinfo>
Nov 10 22:43:48 user nova-compute[75288]:   <os>
Nov 10 22:43:48 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:43:48 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:43:48 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:43:48 user nova-compute[75288]:   </os>
Nov 10 22:43:48 user nova-compute[75288]:   <features>
Nov 10 22:43:48 user nova-compute[75288]:     <acpi/>
Nov 10 22:43:48 user nova-compute[75288]:     <apic/>
Nov 10 22:43:48 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:43:48 user nova-compute[75288]:   </features>
Nov 10 22:43:48 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:43:48 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:43:48 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:43:48 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:43:48 user nova-compute[75288]:   </clock>
Nov 10 22:43:48 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:43:48 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:43:48 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:43:48 user nova-compute[75288]:   </cpu>
Nov 10 22:43:48 user nova-compute[75288]:   <devices>
Nov 10 22:43:48 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:43:48 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:43:48 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk"/>
Nov 10 22:43:48 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:43:48 user nova-compute[75288]:     </disk>
Nov 10 22:43:48 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:43:48 user nova-compute[75288]:       <mac address="fa:16:3e:36:3b:c0"/>
Nov 10 22:43:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:43:48 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:43:48 user nova-compute[75288]:       <target dev="tapa17af079-be"/>
Nov 10 22:43:48 user nova-compute[75288]:     </interface>
Nov 10 22:43:48 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:43:48 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/console.log" append="off"/>
Nov 10 22:43:48 user nova-compute[75288]:     </serial>
Nov 10 22:43:48 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:43:48 user nova-compute[75288]:     <video>
Nov 10 22:43:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:43:48 user nova-compute[75288]:     </video>
Nov 10 22:43:48 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:43:48 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:43:48 user nova-compute[75288]:     </rng>
Nov 10 22:43:48 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:43:48 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:43:48 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:43:48 user nova-compute[75288]:     </memballoon>
Nov 10 22:43:48 user nova-compute[75288]:   </devices>
Nov 10 22:43:48 user nova-compute[75288]: </domain>
Nov 10 22:43:48 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG nova.objects.base [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Cannot resize image /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'migration_context' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG nova.objects.base [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Object Instance<33ebbf72-0319-4e06-af0c-cf1462053666> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG os_vif [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd35169cb-7222-504a-b243-b4639ef0aa0e', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa17af079-be, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa17af079-be, col_values=(('qos', UUID('862eb27a-09f1-4896-93b7-7219352855af')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa17af079-be, col_values=(('external_ids', {'iface-id': 'a17af079-be58-40cc-a993-4d5304f20445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:3b:c0', 'vm-uuid': '33ebbf72-0319-4e06-af0c-cf1462053666'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:43:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:49 user nova-compute[75288]: INFO os_vif [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be')
Nov 10 22:43:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing instance network info cache due to event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] Acquiring lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] Acquired lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updated VIF entry in instance network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:43:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f1a8555b-cbc1-4b4d-baf7-bf0fa80046e0 req-bbdc84bf-7fe9-412b-94de-6b5b4620863d service nova] Releasing lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:43:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:43:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance rebooted successfully.
Nov 10 22:43:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f0b3d15c-f6f7-4d22-a624-145fb8828253 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:43:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:43:56 user nova-compute[75288]: INFO nova.compute.claims [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Claim successful on node user
Nov 10 22:43:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-a4c1f5c5-04c0-4855-9c61-d1611f1954de req-b13230d0-b4d7-44f6-83e1-3fba9b938008 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a4c1f5c5-04c0-4855-9c61-d1611f1954de req-b13230d0-b4d7-44f6-83e1-3fba9b938008 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a4c1f5c5-04c0-4855-9c61-d1611f1954de req-b13230d0-b4d7-44f6-83e1-3fba9b938008 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a4c1f5c5-04c0-4855-9c61-d1611f1954de req-b13230d0-b4d7-44f6-83e1-3fba9b938008 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-a4c1f5c5-04c0-4855-9c61-d1611f1954de req-b13230d0-b4d7-44f6-83e1-3fba9b938008 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:43:56 user nova-compute[75288]: WARNING nova.compute.manager [req-a4c1f5c5-04c0-4855-9c61-d1611f1954de req-b13230d0-b4d7-44f6-83e1-3fba9b938008 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state active and task_state None.
Nov 10 22:43:56 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.827s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:43:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:43:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:43:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Creating image(s)
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "/opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "/opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG nova.policy [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0190cc3da523436fa6cb18cbe36224cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1565a98e78e0494fbe3781e8aba7f68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.303s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk 1073741824" returned: 0 in 0.075s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.241s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-bcd4c198-dea4-45e8-b137-51d70d7c7b87 req-43b0a655-96f3-4a6d-b33a-5d89655b73b5 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bcd4c198-dea4-45e8-b137-51d70d7c7b87 req-43b0a655-96f3-4a6d-b33a-5d89655b73b5 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bcd4c198-dea4-45e8-b137-51d70d7c7b87 req-43b0a655-96f3-4a6d-b33a-5d89655b73b5 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bcd4c198-dea4-45e8-b137-51d70d7c7b87 req-43b0a655-96f3-4a6d-b33a-5d89655b73b5 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-bcd4c198-dea4-45e8-b137-51d70d7c7b87 req-43b0a655-96f3-4a6d-b33a-5d89655b73b5 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:43:58 user nova-compute[75288]: WARNING nova.compute.manager [req-bcd4c198-dea4-45e8-b137-51d70d7c7b87 req-43b0a655-96f3-4a6d-b33a-5d89655b73b5 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state active and task_state None.
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Cannot resize image /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Ensure instance console log exists: /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Successfully created port: 3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:43:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:43:59 user nova-compute[75288]: INFO nova.compute.manager [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Shelving
Nov 10 22:43:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Successfully updated port: 3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "refresh_cache-dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquired lock "refresh_cache-dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:43:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:44:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance destroyed successfully.
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-ba6ad310-3562-4672-88e9-1da176dcf45d req-5370c914-29e3-4336-afca-c78ca87374e9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-unplugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ba6ad310-3562-4672-88e9-1da176dcf45d req-5370c914-29e3-4336-afca-c78ca87374e9 service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ba6ad310-3562-4672-88e9-1da176dcf45d req-5370c914-29e3-4336-afca-c78ca87374e9 service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ba6ad310-3562-4672-88e9-1da176dcf45d req-5370c914-29e3-4336-afca-c78ca87374e9 service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-ba6ad310-3562-4672-88e9-1da176dcf45d req-5370c914-29e3-4336-afca-c78ca87374e9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-unplugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:00 user nova-compute[75288]: WARNING nova.compute.manager [req-ba6ad310-3562-4672-88e9-1da176dcf45d req-5370c914-29e3-4336-afca-c78ca87374e9 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received unexpected event network-vif-unplugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with vm_state active and task_state shelving.
Nov 10 22:44:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Beginning cold snapshot process
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Updating instance_info_cache with network_info: [{"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received event network-changed-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Refreshing instance network info cache due to event network-changed-3465895e-ea81-446f-8a4b-75cc18c2527e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] Acquiring lock "refresh_cache-dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Releasing lock "refresh_cache-dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Instance network_info: |[{"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] Acquired lock "refresh_cache-dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Refreshing network info cache for port 3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Start _get_guest_xml network_info=[{"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:44:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-851556792',display_name='tempest-VolumesActionsTest-instance-851556792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-851556792',id=22,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1565a98e78e0494fbe3781e8aba7f68b',ramdisk_id='',reservation_id='r-ju62ve4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053090080',owner_user_name='tempest-VolumesActionsTest-2053090080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:43:57Z,user_data=None,user_id='0190cc3da523436fa6cb18cbe36224cf',uuid=dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Converting VIF {"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:19:a2,bridge_name='br-int',has_traffic_filtering=True,id=3465895e-ea81-446f-8a4b-75cc18c2527e,network=Network(e54cc5c4-8cb8-4b57-991c-8fe6608b234f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3465895e-ea') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lazy-loading 'pci_devices' on Instance uuid dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:44:00 user nova-compute[75288]:   <uuid>dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6</uuid>
Nov 10 22:44:00 user nova-compute[75288]:   <name>instance-00000016</name>
Nov 10 22:44:00 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:44:00 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:44:00 user nova-compute[75288]:   <metadata>
Nov 10 22:44:00 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:44:00 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:44:00 user nova-compute[75288]:       <nova:name>tempest-VolumesActionsTest-instance-851556792</nova:name>
Nov 10 22:44:00 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:44:00</nova:creationTime>
Nov 10 22:44:00 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:44:00 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:44:00 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:44:00 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:44:00 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:44:00 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:44:00 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:44:00 user nova-compute[75288]:       <nova:owner>
Nov 10 22:44:00 user nova-compute[75288]:         <nova:user uuid="0190cc3da523436fa6cb18cbe36224cf">tempest-VolumesActionsTest-2053090080-project-member</nova:user>
Nov 10 22:44:00 user nova-compute[75288]:         <nova:project uuid="1565a98e78e0494fbe3781e8aba7f68b">tempest-VolumesActionsTest-2053090080</nova:project>
Nov 10 22:44:00 user nova-compute[75288]:       </nova:owner>
Nov 10 22:44:00 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:44:00 user nova-compute[75288]:       <nova:ports>
Nov 10 22:44:00 user nova-compute[75288]:         <nova:port uuid="3465895e-ea81-446f-8a4b-75cc18c2527e">
Nov 10 22:44:00 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:44:00 user nova-compute[75288]:         </nova:port>
Nov 10 22:44:00 user nova-compute[75288]:       </nova:ports>
Nov 10 22:44:00 user nova-compute[75288]:     </nova:instance>
Nov 10 22:44:00 user nova-compute[75288]:   </metadata>
Nov 10 22:44:00 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:44:00 user nova-compute[75288]:     <system>
Nov 10 22:44:00 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:44:00 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:44:00 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:44:00 user nova-compute[75288]:       <entry name="serial">dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6</entry>
Nov 10 22:44:00 user nova-compute[75288]:       <entry name="uuid">dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6</entry>
Nov 10 22:44:00 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:44:00 user nova-compute[75288]:     </system>
Nov 10 22:44:00 user nova-compute[75288]:   </sysinfo>
Nov 10 22:44:00 user nova-compute[75288]:   <os>
Nov 10 22:44:00 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:44:00 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:44:00 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:44:00 user nova-compute[75288]:   </os>
Nov 10 22:44:00 user nova-compute[75288]:   <features>
Nov 10 22:44:00 user nova-compute[75288]:     <acpi/>
Nov 10 22:44:00 user nova-compute[75288]:     <apic/>
Nov 10 22:44:00 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:44:00 user nova-compute[75288]:   </features>
Nov 10 22:44:00 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:44:00 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:44:00 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:44:00 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:44:00 user nova-compute[75288]:   </clock>
Nov 10 22:44:00 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:44:00 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:44:00 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:44:00 user nova-compute[75288]:   </cpu>
Nov 10 22:44:00 user nova-compute[75288]:   <devices>
Nov 10 22:44:00 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:44:00 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:44:00 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk"/>
Nov 10 22:44:00 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:44:00 user nova-compute[75288]:     </disk>
Nov 10 22:44:00 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:44:00 user nova-compute[75288]:       <mac address="fa:16:3e:a1:19:a2"/>
Nov 10 22:44:00 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:00 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:44:00 user nova-compute[75288]:       <target dev="tap3465895e-ea"/>
Nov 10 22:44:00 user nova-compute[75288]:     </interface>
Nov 10 22:44:00 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:44:00 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/console.log" append="off"/>
Nov 10 22:44:00 user nova-compute[75288]:     </serial>
Nov 10 22:44:00 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:44:00 user nova-compute[75288]:     <video>
Nov 10 22:44:00 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:00 user nova-compute[75288]:     </video>
Nov 10 22:44:00 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:44:00 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:44:00 user nova-compute[75288]:     </rng>
Nov 10 22:44:00 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:44:00 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:44:00 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:44:00 user nova-compute[75288]:     </memballoon>
Nov 10 22:44:00 user nova-compute[75288]:   </devices>
Nov 10 22:44:00 user nova-compute[75288]: </domain>
Nov 10 22:44:00 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-851556792',display_name='tempest-VolumesActionsTest-instance-851556792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-851556792',id=22,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1565a98e78e0494fbe3781e8aba7f68b',ramdisk_id='',reservation_id='r-ju62ve4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053090080',owner_user_name='tempest-VolumesActionsTest-2053090080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:43:57Z,user_data=None,user_id='0190cc3da523436fa6cb18cbe36224cf',uuid=dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Converting VIF {"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:19:a2,bridge_name='br-int',has_traffic_filtering=True,id=3465895e-ea81-446f-8a4b-75cc18c2527e,network=Network(e54cc5c4-8cb8-4b57-991c-8fe6608b234f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3465895e-ea') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG os_vif [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:19:a2,bridge_name='br-int',has_traffic_filtering=True,id=3465895e-ea81-446f-8a4b-75cc18c2527e,network=Network(e54cc5c4-8cb8-4b57-991c-8fe6608b234f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3465895e-ea') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99609f24-9f8a-597a-b565-e9c59850426a', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3465895e-ea, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3465895e-ea, col_values=(('qos', UUID('5cbce395-e9d4-4f8b-9a61-826f591aee00')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3465895e-ea, col_values=(('external_ids', {'iface-id': '3465895e-ea81-446f-8a4b-75cc18c2527e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:19:a2', 'vm-uuid': 'dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:00 user nova-compute[75288]: INFO os_vif [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:19:a2,bridge_name='br-int',has_traffic_filtering=True,id=3465895e-ea81-446f-8a4b-75cc18c2527e,network=Network(e54cc5c4-8cb8-4b57-991c-8fe6608b234f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3465895e-ea')
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk /opt/stack/data/nova/instances/snapshots/tmpr690ntr9/51c3259ae1724215b6036f87636e09ae {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:44:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] No VIF found with MAC fa:16:3e:a1:19:a2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:44:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 70c0e693-25bf-45bb-80b8-a3829e58a067 is timed out.
Nov 10 22:44:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully detached device vdb from instance 70c0e693-25bf-45bb-80b8-a3829e58a067 from the live domain config.
Nov 10 22:44:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXTlPuNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:01 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:01 user nova-compute[75288]: INFO nova.compute.manager [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Terminating instance
Nov 10 22:44:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.070s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c69f0-211b-4718-b8ba-2cd138827ea0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:44:01 user nova-compute[75288]: No targets found.
Nov 10 22:44:01 user nova-compute[75288]: iSNS:
Nov 10 22:44:01 user nova-compute[75288]: No targets found.
Nov 10 22:44:01 user nova-compute[75288]: STATIC:
Nov 10 22:44:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:44:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:01 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7
Nov 10 22:44:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:01 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14
Nov 10 22:44:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:01 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:01 user nova-compute[75288]: FIRMWARE:
Nov 10 22:44:01 user nova-compute[75288]: No targets found.
Nov 10 22:44:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:44:01 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:44:01 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Updated VIF entry in instance network info cache for port 3465895e-ea81-446f-8a4b-75cc18c2527e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Updating instance_info_cache with network_info: [{"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.054s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a044325-d922-4665-ae9a-ffc945e767ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-44d18531-268c-4075-93db-54a6d1f4dc92 req-210ea229-f4fb-4d9d-bf63-60cede56cbda service nova] Releasing lock "refresh_cache-dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e157797-c170-4a9e-b3e6-df06ebe1afc4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:01 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:01 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 (non-flash)
Nov 10 22:44:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:01 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:01 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 (non-flash)
Nov 10 22:44:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b2a7ec670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bbf8a3-e0bf-4279-b6cd-4df4e83999b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f2b22e-3e20-4818-aa6d-a4b47887cf0b]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3355638-24c1-411a-a101-eac616db30aa]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.103s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea010f2-a628-4917-a7ef-e5e8bacc4522]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk /opt/stack/data/nova/instances/snapshots/tmpr690ntr9/51c3259ae1724215b6036f87636e09ae" returned: 0 in 0.744s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Snapshot extracted, beginning image upload
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fd545-8ec5-465f-843a-8207a78d819f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[632664b9-ada9-42f0-9f57-39443d9f4fa4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260]
Nov 10 22:44:01 user nova-compute[75288]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7, portal: 172.16.0.220,3260] successful.
Nov 10 22:44:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480f38c3-0d0f-455f-b563-271a29ed66f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a7561a-d33b-4626-b753-5140c154f7f1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.557s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] <== disconnect_volume: return (559ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDHCLMfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bce81d0-809c-4c80-8740-c0277d7a290d', 'attached_at': '', 'detached_at': '', 'volume_id': '382b1889-1dfe-4beb-a15c-c1848b180a3f', 'serial': '382b1889-1dfe-4beb-a15c-c1848b180a3f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5bce81d0-809c-4c80-8740-c0277d7a290d', 'attached_at': '', 'detached_at': '', 'volume_id': '82fccb8c-c07d-447d-bc1f-85b71991ec14', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDHCLMfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:01 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:01 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:01 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[921dea5a-bdbd-4d7c-b6ee-a2bb32c5197b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:44:01 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbde63cf-0bb5-4bc4-b228-a382c86ebdb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f] added
Nov 10 22:44:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b37baa4-2835-4c68-a14c-c1fffa3869d5]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37971c7a-3ea9-42f8-8050-850b0a8f5dc3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDHCLMfB {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDHCLMfB" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf7aa10-6899-461f-9af9-47896be9ffe7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDHCLMfB'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aa3473-8d31-4dbf-a6f9-8ae06205a090]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[114b3591-0383-491b-ac51-1c34d66b339a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:02 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:02 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99efc8-b77d-4afe-98e7-775f4e2a0841]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260]
Nov 10 22:44:02 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260] successful.
Nov 10 22:44:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cdbd5c-1369-4bdd-a030-6ffdd9890ca0]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e2f77a-a318-44fd-8218-c90717d97563]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:02 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:02 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:02 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:02 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.037s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f683375c-cbc5-4279-b1a6-11aa2d66cc84]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDHCLMfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:02 user nova-compute[75288]: WARNING nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received unexpected event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-unplugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-unplugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-unplugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Acquiring lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] No waiting events found dispatching network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:02 user nova-compute[75288]: WARNING nova.compute.manager [req-1fb9ce70-8cea-4c8d-b443-684b3e41d654 req-4143eb77-62f9-4904-affe-5b1b26ba664e service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received unexpected event network-vif-plugged-833ea9cc-5b3c-45d9-a790-58a325399f50 for instance with vm_state active and task_state deleting.
Nov 10 22:44:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Instance destroyed successfully.
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.objects.instance [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'resources' on Instance uuid f9c056b7-56a6-4dd9-972b-7290c27c8fcf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-787401219',display_name='tempest-ServerActionsTestOtherA-server-706973279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-787401219',id=12,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgur9VwcRgcPAddQ2yq2SDKWwkCHOc79qk3MMstyvI4JbzUO7We++xhPD+OI0zsJ8ZIjY2xd7tJ3cZf88cGEqNEfrxS53zEnlcJXT2NxUBnilmBfl9N4p955pTEXCQ+jg==',key_name='tempest-keypair-1131382431',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-i8dgfs40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=f9c056b7-56a6-4dd9-972b-7290c27c8fcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "833ea9cc-5b3c-45d9-a790-58a325399f50", "address": "fa:16:3e:ef:ad:c3", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap833ea9cc-5b", "ovs_interfaceid": "833ea9cc-5b3c-45d9-a790-58a325399f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG os_vif [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap833ea9cc-5b, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d474f96-4e87-4af2-8676-92f9a5574f48) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:02 user nova-compute[75288]: INFO os_vif [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:c3,bridge_name='br-int',has_traffic_filtering=True,id=833ea9cc-5b3c-45d9-a790-58a325399f50,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap833ea9cc-5b')
Nov 10 22:44:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Deleting instance files /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf_del
Nov 10 22:44:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Deletion of /opt/stack/data/nova/instances/f9c056b7-56a6-4dd9-972b-7290c27c8fcf_del complete
Nov 10 22:44:03 user nova-compute[75288]: INFO nova.compute.manager [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Took 2.00 seconds to destroy the instance on the hypervisor.
Nov 10 22:44:03 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23864343965343532', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864343965343532', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lazy-loading 'flavor' on Instance uuid 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-21aa516a-ff49-43ec-a3ad-c348a34c1212 req-33c5e9db-026c-4fa3-986e-61a80c8d29ce service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received event network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-21aa516a-ff49-43ec-a3ad-c348a34c1212 req-33c5e9db-026c-4fa3-986e-61a80c8d29ce service nova] Acquiring lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-21aa516a-ff49-43ec-a3ad-c348a34c1212 req-33c5e9db-026c-4fa3-986e-61a80c8d29ce service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-21aa516a-ff49-43ec-a3ad-c348a34c1212 req-33c5e9db-026c-4fa3-986e-61a80c8d29ce service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-21aa516a-ff49-43ec-a3ad-c348a34c1212 req-33c5e9db-026c-4fa3-986e-61a80c8d29ce service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] No waiting events found dispatching network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:04 user nova-compute[75288]: WARNING nova.compute.manager [req-21aa516a-ff49-43ec-a3ad-c348a34c1212 req-33c5e9db-026c-4fa3-986e-61a80c8d29ce service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received unexpected event network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e for instance with vm_state building and task_state spawning.
Nov 10 22:44:04 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:04 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Took 1.17 seconds to deallocate network for instance.
Nov 10 22:44:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-5dbae7a3-2719-4838-9c1f-dfdf076e6fe4 req-e77674d8-d8d9-4a78-8ebe-a7a1c3f1fd04 service nova] [instance: f9c056b7-56a6-4dd9-972b-7290c27c8fcf] Received event network-vif-deleted-833ea9cc-5b3c-45d9-a790-58a325399f50 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 279969792 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.895s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Snapshot image upload complete
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:44:05 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Deleted allocations for instance f9c056b7-56a6-4dd9-972b-7290c27c8fcf
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 396361728 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:05 user nova-compute[75288]: INFO nova.compute.manager [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Shelve offloading
Nov 10 22:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-629b7861-caaa-4bca-a073-267bbf6d633e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "f9c056b7-56a6-4dd9-972b-7290c27c8fcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.524s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance destroyed successfully.
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquired lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:44:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Instance spawned successfully.
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 522190848 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:06 user nova-compute[75288]: INFO nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Took 8.86 seconds to spawn the instance on the hypervisor.
Nov 10 22:44:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-3151048f-de7b-4064-9739-4df843b499ea req-f8daf464-5329-4464-8084-1d86cb8c9f12 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received event network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3151048f-de7b-4064-9739-4df843b499ea req-f8daf464-5329-4464-8084-1d86cb8c9f12 service nova] Acquiring lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3151048f-de7b-4064-9739-4df843b499ea req-f8daf464-5329-4464-8084-1d86cb8c9f12 service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3151048f-de7b-4064-9739-4df843b499ea req-f8daf464-5329-4464-8084-1d86cb8c9f12 service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-3151048f-de7b-4064-9739-4df843b499ea req-f8daf464-5329-4464-8084-1d86cb8c9f12 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] No waiting events found dispatching network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:06 user nova-compute[75288]: WARNING nova.compute.manager [req-3151048f-de7b-4064-9739-4df843b499ea req-f8daf464-5329-4464-8084-1d86cb8c9f12 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received unexpected event network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e for instance with vm_state building and task_state spawning.
Nov 10 22:44:06 user nova-compute[75288]: INFO nova.compute.manager [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Took 10.33 seconds to build instance.
Nov 10 22:44:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5763d697-fd1a-4b68-aed0-7eb30ec49d5c tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.480s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 665845760 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Releasing lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:44:07 user nova-compute[75288]: INFO nova.compute.claims [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Claim successful on node user
Nov 10 22:44:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 943718400 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 1056964608 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.893s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:44:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:44:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance destroyed successfully.
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'resources' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-348158825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-348158825',id=19,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl3bnDr6iWD2rDxViaXHLOHvBAxs6kgwoH4KHi0DyqdB+X0ShLlFByhguU1fNi4/if+gomSn7bK/KT9k2KIha7W5cZLDZnZLRjdK9prTch89nrolMuTJz6JRNi6ZY3J9g==',key_name='tempest-keypair-276005353',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-lihpwz8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member',shelved_at='2023-11-10T22:44:05.429333',shelved_host='user',shelved_image_id='8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:44:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=42be4921-aac5-4ee5-9564-455e9558ded0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_vif [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing instance network info cache due to event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] Acquiring lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] Acquired lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap004daad5-a7, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.policy [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fe7181c0c964009b7a5707633a23191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd112e7d16b9643a88cd0f352a57c935c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=448ccd55-e1b8-4a5a-992c-a5e536253183) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:08 user nova-compute[75288]: INFO os_vif [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7')
Nov 10 22:44:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Deleting instance files /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0_del
Nov 10 22:44:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Deletion of /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0_del complete
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:44:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Creating image(s)
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "/opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "/opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "/opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:08 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Deleted allocations for instance 42be4921-aac5-4ee5-9564-455e9558ded0
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'numa_topology' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.objects.base [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<42be4921-aac5-4ee5-9564-455e9558ded0> lazy-loaded attributes: resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:08 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.279s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eae903-d154-4433-8771-91a6592f31ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:44:08 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7252f5c-7bdc-4eb5-91d1-6c6923a17d54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420] added
Nov 10 22:44:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92ddda-2078-49a8-bb33-1a75ad832251]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df44600-baaf-4aa0-9e5b-2011b8696b57]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBxmJSRy {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updated VIF entry in instance network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap004daad5-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBxmJSRy" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb694cb-a2d8-4b41-8ade-119fbadc457f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBxmJSRy'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bf031b4-6a25-466b-829e-80d4224e0606 req-b4b7632c-8006-4370-b1c2-42d2f789d229 service nova] Releasing lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce7c1c9-08ae-4acc-ad9f-ae2ff47cb788]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42a14e-7766-4a88-b986-b5dcddfeb0a5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:08 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:08 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:08 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:08 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.241s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk 1073741824" returned: 0 in 0.057s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8febc5e5-c681-4efb-8a96-cf5a8dd43bba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]
Nov 10 22:44:09 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.
Nov 10 22:44:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d626565-0450-4867-b195-f70ad793e6c0]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[742ee900-1e0f-4858-b3e1-a8654435275c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:09 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:09 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:09 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:44:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:09 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:09 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:09 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:44:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e873e21-2d66-4fd8-bef7-c4c28eb52ab6]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Cannot resize image /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Ensure instance console log exists: /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.960s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Successfully created port: e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:44:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a6ae6acc-f903-4cc4-82ba-0eefd736d912 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 10.232s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '23365633339663465', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365633339663465', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.421s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.objects.instance [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lazy-loading 'flavor' on Instance uuid b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b8bfb0-7ba3-4a6b-9a6b-1354d7aacf61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:44:10 user nova-compute[75288]: No targets found.
Nov 10 22:44:10 user nova-compute[75288]: iSNS:
Nov 10 22:44:10 user nova-compute[75288]: No targets found.
Nov 10 22:44:10 user nova-compute[75288]: STATIC:
Nov 10 22:44:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f
Nov 10 22:44:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:10 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:44:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:10 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420
Nov 10 22:44:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:10 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14
Nov 10 22:44:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:10 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:10 user nova-compute[75288]: FIRMWARE:
Nov 10 22:44:10 user nova-compute[75288]: No targets found.
Nov 10 22:44:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:44:10 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:44:10 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:44:10 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:44:10 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:44:10 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:44:10 user nova-compute[75288]:   <serial>4f3faf58-a34d-4eb7-b3cc-8ecd91584420</serial>
Nov 10 22:44:10 user nova-compute[75288]: </disk>
Nov 10 22:44:10 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ad1d6-fba9-4336-bf2f-d0dda386f8f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[861bca25-b78f-417e-82dc-575dde6402e7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:10 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:10 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:10 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:44:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:10 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:10 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:10 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:44:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b20117130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee9fc04-3a5a-4367-a91a-12a070f4a62e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19727f26-3b53-4ab7-a594-1400a40f9ae9]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2091f0-ccbc-422d-b620-d2847c06d62e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c5149-d40d-4413-99c4-46713546178d]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18421a07-093b-405c-a170-9a684ba8ae87]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Successfully updated port: e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquired lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-changed-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Refreshing instance network info cache due to event network-changed-e7bac544-b5fc-4020-af9f-183a0208faa1. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] Acquiring lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5957f3fb-58dc-4490-a994-bab1b05c0392]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]
Nov 10 22:44:10 user nova-compute[75288]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.
Nov 10 22:44:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c822d6ac-17e0-4e55-bd39-ddec4b87a587]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] <== disconnect_volume: return (1801ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDHCLMfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5bce81d0-809c-4c80-8740-c0277d7a290d', 'attached_at': '', 'detached_at': '', 'volume_id': '382b1889-1dfe-4beb-a15c-c1848b180a3f', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] swap_volume: removing Cinder connection for volume 82fccb8c-c07d-447d-bc1f-85b71991ec14 {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No VIF found with MAC fa:16:3e:4f:a7:85, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:44:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-54aded4b-afd5-4923-8636-7c0c2ddc10bd tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.151s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating instance_info_cache with network_info: [{"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Releasing lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Instance network_info: |[{"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] Acquired lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Refreshing network info cache for port e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Start _get_guest_xml network_info=[{"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:44:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-78431812',display_name='tempest-SnapshotDataIntegrityTests-server-78431812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-78431812',id=23,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzO1w095MqiWmB1DP0Wfehf0Syfzumc8581xkK9GuzcwmJ2AnDupPEb2BXk90aQ0Ql9nZuFg5lvEPNQbKLuDHmaJlZPA+RVFuGBZAd5MYGW7mvE1PwZQ8IKGfbXxhtZCQ==',key_name='tempest-keypair-560160790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d112e7d16b9643a88cd0f352a57c935c',ramdisk_id='',reservation_id='r-mtki41rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1829388035',owner_user_name='tempest-SnapshotDataIntegrityTests-1829388035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe7181c0c964009b7a5707633a23191',uuid=d47e90fb-6b83-4b5e-98dd-3c6e86951006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Converting VIF {"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:97,bridge_name='br-int',has_traffic_filtering=True,id=e7bac544-b5fc-4020-af9f-183a0208faa1,network=Network(a405802d-4cc0-49ed-9180-4a2708c881d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7bac544-b5') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'pci_devices' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:44:11 user nova-compute[75288]:   <uuid>d47e90fb-6b83-4b5e-98dd-3c6e86951006</uuid>
Nov 10 22:44:11 user nova-compute[75288]:   <name>instance-00000017</name>
Nov 10 22:44:11 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:44:11 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:44:11 user nova-compute[75288]:   <metadata>
Nov 10 22:44:11 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:44:11 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:44:11 user nova-compute[75288]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-78431812</nova:name>
Nov 10 22:44:11 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:44:11</nova:creationTime>
Nov 10 22:44:11 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:44:11 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:44:11 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:44:11 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:44:11 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:44:11 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:44:11 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:44:11 user nova-compute[75288]:       <nova:owner>
Nov 10 22:44:11 user nova-compute[75288]:         <nova:user uuid="9fe7181c0c964009b7a5707633a23191">tempest-SnapshotDataIntegrityTests-1829388035-project-member</nova:user>
Nov 10 22:44:11 user nova-compute[75288]:         <nova:project uuid="d112e7d16b9643a88cd0f352a57c935c">tempest-SnapshotDataIntegrityTests-1829388035</nova:project>
Nov 10 22:44:11 user nova-compute[75288]:       </nova:owner>
Nov 10 22:44:11 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:44:11 user nova-compute[75288]:       <nova:ports>
Nov 10 22:44:11 user nova-compute[75288]:         <nova:port uuid="e7bac544-b5fc-4020-af9f-183a0208faa1">
Nov 10 22:44:11 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 22:44:11 user nova-compute[75288]:         </nova:port>
Nov 10 22:44:11 user nova-compute[75288]:       </nova:ports>
Nov 10 22:44:11 user nova-compute[75288]:     </nova:instance>
Nov 10 22:44:11 user nova-compute[75288]:   </metadata>
Nov 10 22:44:11 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:44:11 user nova-compute[75288]:     <system>
Nov 10 22:44:11 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:44:11 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:44:11 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:44:11 user nova-compute[75288]:       <entry name="serial">d47e90fb-6b83-4b5e-98dd-3c6e86951006</entry>
Nov 10 22:44:11 user nova-compute[75288]:       <entry name="uuid">d47e90fb-6b83-4b5e-98dd-3c6e86951006</entry>
Nov 10 22:44:11 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:44:11 user nova-compute[75288]:     </system>
Nov 10 22:44:11 user nova-compute[75288]:   </sysinfo>
Nov 10 22:44:11 user nova-compute[75288]:   <os>
Nov 10 22:44:11 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:44:11 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:44:11 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:44:11 user nova-compute[75288]:   </os>
Nov 10 22:44:11 user nova-compute[75288]:   <features>
Nov 10 22:44:11 user nova-compute[75288]:     <acpi/>
Nov 10 22:44:11 user nova-compute[75288]:     <apic/>
Nov 10 22:44:11 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:44:11 user nova-compute[75288]:   </features>
Nov 10 22:44:11 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:44:11 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:44:11 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:44:11 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:44:11 user nova-compute[75288]:   </clock>
Nov 10 22:44:11 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:44:11 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:44:11 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:44:11 user nova-compute[75288]:   </cpu>
Nov 10 22:44:11 user nova-compute[75288]:   <devices>
Nov 10 22:44:11 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:44:11 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:44:11 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk"/>
Nov 10 22:44:11 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:44:11 user nova-compute[75288]:     </disk>
Nov 10 22:44:11 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:44:11 user nova-compute[75288]:       <mac address="fa:16:3e:81:41:97"/>
Nov 10 22:44:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:11 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:44:11 user nova-compute[75288]:       <target dev="tape7bac544-b5"/>
Nov 10 22:44:11 user nova-compute[75288]:     </interface>
Nov 10 22:44:11 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:44:11 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/console.log" append="off"/>
Nov 10 22:44:11 user nova-compute[75288]:     </serial>
Nov 10 22:44:11 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:44:11 user nova-compute[75288]:     <video>
Nov 10 22:44:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:11 user nova-compute[75288]:     </video>
Nov 10 22:44:11 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:44:11 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:44:11 user nova-compute[75288]:     </rng>
Nov 10 22:44:11 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:44:11 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:44:11 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:44:11 user nova-compute[75288]:     </memballoon>
Nov 10 22:44:11 user nova-compute[75288]:   </devices>
Nov 10 22:44:11 user nova-compute[75288]: </domain>
Nov 10 22:44:11 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-78431812',display_name='tempest-SnapshotDataIntegrityTests-server-78431812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-78431812',id=23,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzO1w095MqiWmB1DP0Wfehf0Syfzumc8581xkK9GuzcwmJ2AnDupPEb2BXk90aQ0Ql9nZuFg5lvEPNQbKLuDHmaJlZPA+RVFuGBZAd5MYGW7mvE1PwZQ8IKGfbXxhtZCQ==',key_name='tempest-keypair-560160790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d112e7d16b9643a88cd0f352a57c935c',ramdisk_id='',reservation_id='r-mtki41rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1829388035',owner_user_name='tempest-SnapshotDataIntegrityTests-1829388035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe7181c0c964009b7a5707633a23191',uuid=d47e90fb-6b83-4b5e-98dd-3c6e86951006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Converting VIF {"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:97,bridge_name='br-int',has_traffic_filtering=True,id=e7bac544-b5fc-4020-af9f-183a0208faa1,network=Network(a405802d-4cc0-49ed-9180-4a2708c881d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7bac544-b5') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG os_vif [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:97,bridge_name='br-int',has_traffic_filtering=True,id=e7bac544-b5fc-4020-af9f-183a0208faa1,network=Network(a405802d-4cc0-49ed-9180-4a2708c881d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7bac544-b5') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a23b673-80df-5aad-815e-ef819c1e05b3', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7bac544-b5, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7bac544-b5, col_values=(('qos', UUID('0522f53f-3a4a-4b37-887d-906ac70e5fad')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7bac544-b5, col_values=(('external_ids', {'iface-id': 'e7bac544-b5fc-4020-af9f-183a0208faa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:41:97', 'vm-uuid': 'd47e90fb-6b83-4b5e-98dd-3c6e86951006'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:11 user nova-compute[75288]: INFO os_vif [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:41:97,bridge_name='br-int',has_traffic_filtering=True,id=e7bac544-b5fc-4020-af9f-183a0208faa1,network=Network(a405802d-4cc0-49ed-9180-4a2708c881d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7bac544-b5')
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No VIF found with MAC fa:16:3e:81:41:97, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updated VIF entry in instance network info cache for port e7bac544-b5fc-4020-af9f-183a0208faa1. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating instance_info_cache with network_info: [{"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e83e01f4-e2be-4a93-8c19-c661a156f871 req-9bf7fabf-68e9-46de-9914-403ba28be3b7 service nova] Releasing lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] swap_volume: Updating volume 82fccb8c-c07d-447d-bc1f-85b71991ec14 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rDHCLMfB", "auth_password": "ikRfBFrUq9s5L1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "382b1889-1dfe-4beb-a15c-c1848b180a3f"}, "status": "reserved", "instance": "5bce81d0-809c-4c80-8740-c0277d7a290d", "attached_at": "", "detached_at": "", "volume_id": "382b1889-1dfe-4beb-a15c-c1848b180a3f", "serial": "382b1889-1dfe-4beb-a15c-c1848b180a3f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '382b1889-1dfe-4beb-a15c-c1848b180a3f', 'no_device': None, 'attachment_id': '5dc8979a-13fd-4396-8ea2-df4418221c1f'} {{(pid=75288) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 22:44:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-617b8006-c84b-4326-a548-25f713529003 tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 41.057s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG os_brick.utils [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ed78d-6990-4f3a-9173-505d2fc010bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'flavor' on Instance uuid 70c0e693-25bf-45bb-80b8-a3829e58a067 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c533791-98f2-4c3e-8cba-cbefce099a5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a85c8ec-0bba-47d1-82f9-13c66747ebc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[39836ff9-8908-4eae-95d6-fc9b8d05bc67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b699fb93-7e04-4c3d-930f-826bf8d28e41 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.493s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:44:12 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:44:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[669b320f-3d23-4298-8fa2-e63333ded2fd]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG os_brick.utils [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Stashing vm_state: active {{(pid=75288) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-349c48d6-87da-4d24-b09b-60251bd811ef req-2c055004-5e68-4010-9eb0-83fde3d5589d service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-349c48d6-87da-4d24-b09b-60251bd811ef req-2c055004-5e68-4010-9eb0-83fde3d5589d service nova] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-349c48d6-87da-4d24-b09b-60251bd811ef req-2c055004-5e68-4010-9eb0-83fde3d5589d service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-349c48d6-87da-4d24-b09b-60251bd811ef req-2c055004-5e68-4010-9eb0-83fde3d5589d service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-349c48d6-87da-4d24-b09b-60251bd811ef req-2c055004-5e68-4010-9eb0-83fde3d5589d service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] No waiting events found dispatching network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:13 user nova-compute[75288]: WARNING nova.compute.manager [req-349c48d6-87da-4d24-b09b-60251bd811ef req-2c055004-5e68-4010-9eb0-83fde3d5589d service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received unexpected event network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 for instance with vm_state building and task_state spawning.
Nov 10 22:44:13 user nova-compute[75288]: INFO nova.compute.manager [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Swapping volume 382b1889-1dfe-4beb-a15c-c1848b180a3f for 82fccb8c-c07d-447d-bc1f-85b71991ec14
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:44:13 user nova-compute[75288]: INFO nova.compute.claims [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Claim successful on node user
Nov 10 22:44:13 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating resource usage from migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d
Nov 10 22:44:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.582s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:13 user nova-compute[75288]: INFO nova.compute.manager [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Migrating
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:13 user nova-compute[75288]: INFO nova.compute.rpcapi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:44:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Starting migrate_disk_and_power_off {{(pid=75288) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 22:44:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-efab4193-e17c-43ec-9ab7-df88bab68438 req-b9096825-4966-4f73-b0e0-43dfd4b02535 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-unplugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-efab4193-e17c-43ec-9ab7-df88bab68438 req-b9096825-4966-4f73-b0e0-43dfd4b02535 service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-efab4193-e17c-43ec-9ab7-df88bab68438 req-b9096825-4966-4f73-b0e0-43dfd4b02535 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-efab4193-e17c-43ec-9ab7-df88bab68438 req-b9096825-4966-4f73-b0e0-43dfd4b02535 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-efab4193-e17c-43ec-9ab7-df88bab68438 req-b9096825-4966-4f73-b0e0-43dfd4b02535 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-unplugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:15 user nova-compute[75288]: WARNING nova.compute.manager [req-efab4193-e17c-43ec-9ab7-df88bab68438 req-b9096825-4966-4f73-b0e0-43dfd4b02535 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-unplugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state active and task_state resize_migrating.
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:44:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Instance spawned successfully.
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:44:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance destroyed successfully.
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1763701259',display_name='tempest-ServerActionsTestOtherB-server-1763701259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1763701259',id=16,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuF/yviImHglYGIXiLmfbAvxX1/9/n49hx51CEU4vPIIK0cwYCFjIHSOmrYvu7mdk8fQPm8oJwZeKNCXTTt3FJg6Tq2wup2YgajWX6dwhMXP1Xwfv2hMNZnvwgRC226mA==',key_name='tempest-keypair-37753185',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:39:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='224fa7e9054147d4aa63826efaa17392',ramdisk_id='',reservation_id='r-hxndv4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594854393',owner_user_name='tempest-ServerActionsTestOtherB-594854393-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c5517f32c04ad498f307b9b89c6a45',uuid=b9342997-048d-4f4f-a552-de76f2a0a444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1367405680-network", "vif_mac": "fa:16:3e:4f:a7:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converting VIF {"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1367405680-network", "vif_mac": "fa:16:3e:4f:a7:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_vif [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap909c66a6-f3, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bccfd2f6-83ea-41ec-916d-93ce187abe9d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:15 user nova-compute[75288]: INFO os_vif [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3')
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f3058f1f-0141-4ff6-930a-7be890c29ecd req-86cece25-f601-4485-94e1-4480caf44c8c service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f3058f1f-0141-4ff6-930a-7be890c29ecd req-86cece25-f601-4485-94e1-4480caf44c8c service nova] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f3058f1f-0141-4ff6-930a-7be890c29ecd req-86cece25-f601-4485-94e1-4480caf44c8c service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f3058f1f-0141-4ff6-930a-7be890c29ecd req-86cece25-f601-4485-94e1-4480caf44c8c service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f3058f1f-0141-4ff6-930a-7be890c29ecd req-86cece25-f601-4485-94e1-4480caf44c8c service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] No waiting events found dispatching network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:15 user nova-compute[75288]: WARNING nova.compute.manager [req-f3058f1f-0141-4ff6-930a-7be890c29ecd req-86cece25-f601-4485-94e1-4480caf44c8c service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received unexpected event network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 for instance with vm_state building and task_state spawning.
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:15 user nova-compute[75288]: INFO nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[846227aa-9a26-4f46-9b5e-4cec5093c88a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:44:15 user nova-compute[75288]: No targets found.
Nov 10 22:44:15 user nova-compute[75288]: iSNS:
Nov 10 22:44:15 user nova-compute[75288]: No targets found.
Nov 10 22:44:15 user nova-compute[75288]: STATIC:
Nov 10 22:44:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f
Nov 10 22:44:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:15 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:44:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:15 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420
Nov 10 22:44:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:15 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:15 user nova-compute[75288]: FIRMWARE:
Nov 10 22:44:15 user nova-compute[75288]: No targets found.
Nov 10 22:44:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:44:15 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:44:15 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c896794-4e25-48ea-a319-f638c7a9706a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: INFO nova.compute.manager [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Took 8.51 seconds to build instance.
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43d43e7-4ce2-437f-81d3-2c1ace4a85dd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:15 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:15 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:44:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:15 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:15 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:44:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b201c7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9652ea5b-49ec-4c5c-8600-ccff4d7bbd22 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.677s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a19058c-b2fd-4a5a-9da8-2a552a697fb2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e45577-be79-4e84-9e49-99e2f37b6079]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[13931e71-ffaf-4d75-95b0-07c4749506af]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b16b28-99e5-43ad-9b9f-8eedd75928a6]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514f84d-de67-4071-b0b2-03c942b998af]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f452308-f6d8-45c7-8762-e99f22f02b73]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]
Nov 10 22:44:15 user nova-compute[75288]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.
Nov 10 22:44:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0402daa8-cccc-4eb9-9788-5cd2a7185eff]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== disconnect_volume: return (348ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize/disk /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "cp -r /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize/disk /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk" returned: 0 in 0.387s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize/disk.info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk.info {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "cp -r /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize/disk.info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk.info" returned: 0 in 0.046s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d019fbd-fd9f-498c-9967-bd99a53b02c5 req-40daacc1-5b2a-491b-85bb-a236493b5433 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d019fbd-fd9f-498c-9967-bd99a53b02c5 req-40daacc1-5b2a-491b-85bb-a236493b5433 service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d019fbd-fd9f-498c-9967-bd99a53b02c5 req-40daacc1-5b2a-491b-85bb-a236493b5433 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d019fbd-fd9f-498c-9967-bd99a53b02c5 req-40daacc1-5b2a-491b-85bb-a236493b5433 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d019fbd-fd9f-498c-9967-bd99a53b02c5 req-40daacc1-5b2a-491b-85bb-a236493b5433 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:17 user nova-compute[75288]: WARNING nova.compute.manager [req-7d019fbd-fd9f-498c-9967-bd99a53b02c5 req-40daacc1-5b2a-491b-85bb-a236493b5433 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state active and task_state resize_migrating.
Nov 10 22:44:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:44:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:44:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updating instance_info_cache with network_info: [{"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:44:22 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:44:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:44:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7390MB free_disk=25.24652099609375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Applying migration context for instance b9342997-048d-4f4f-a552-de76f2a0a444 as it has an incoming, in-progress migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d. Migration status is migrating {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 22:44:27 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating resource usage from migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5bce81d0-809c-4c80-8740-c0277d7a290d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:44:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:44:28 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:44:28 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:44:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:44:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:44:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bce81d0-809c-4c80-8740-c0277d7a290d', 'attached_at': '', 'detached_at': '', 'volume_id': '82fccb8c-c07d-447d-bc1f-85b71991ec14', 'serial': '82fccb8c-c07d-447d-bc1f-85b71991ec14'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDHCLMfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '382b1889-1dfe-4beb-a15c-c1848b180a3f'}, 'status': 'reserved', 'instance': '5bce81d0-809c-4c80-8740-c0277d7a290d', 'attached_at': '', 'detached_at': '', 'volume_id': '382b1889-1dfe-4beb-a15c-c1848b180a3f', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:40 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Port 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 binding to destination host user is already ACTIVE {{(pid=75288) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d65a723-6463-4929-a7a8-98a060931d99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:44:40 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a3ed08-0507-4982-9bbf-38170aa4761c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14] added
Nov 10 22:44:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[76905fca-a4bc-4a67-86cb-b37537dbf9ac]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6627acf0-7698-4a07-a442-19d833e84527]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyetphaS {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyetphaS" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74fdfad-ad01-4679-80ea-183326e27b57]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LyetphaS'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd17ff0-9714-4fed-b24e-3866ff1fd184]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8ceffb-e776-4f19-9798-1b3c5fca812d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:40 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:40 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd03a36-17a2-42ce-8374-9e03b03ebfeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]
Nov 10 22:44:40 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.
Nov 10 22:44:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4958cd4b-10c6-48e8-a993-9e378827d5f8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[490e4510-b998-49ce-9d3a-b6b99eb5b105]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:40 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:40 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:40 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:40 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0abd41-7d53-4c09-b118-9c12e77ab72c]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.utils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd09c77-9c75-4fee-91e3-5560d7402729]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d877c7e-5e0d-4adc-9429-dfab96b461f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[307934cc-a151-4446-b35f-d4b609cf183f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f9c39-0bdf-49e7-8b42-e9bc36bec920]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:44:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:44:41 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:44:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f028bf-b630-4b59-bc4a-a480eb1341c4]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.utils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23330383032346466', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330383032346466', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lazy-loading 'flavor' on Instance uuid 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 300941312 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 471859200 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 622854144 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 780140544 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 917504000 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:44:45 user nova-compute[75288]: INFO nova.compute.manager [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] instance snapshotting
Nov 10 22:44:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Beginning live snapshot process
Nov 10 22:44:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDHCLMfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '382b1889-1dfe-4beb-a15c-c1848b180a3f'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:45 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5f9b4-29a0-4413-8808-c2bfedb51f3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:44:45 user nova-compute[75288]: No targets found.
Nov 10 22:44:45 user nova-compute[75288]: iSNS:
Nov 10 22:44:45 user nova-compute[75288]: No targets found.
Nov 10 22:44:45 user nova-compute[75288]: STATIC:
Nov 10 22:44:45 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f
Nov 10 22:44:45 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:45 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:45 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:44:45 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:45 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:45 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14
Nov 10 22:44:45 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:44:45 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:44:45 user nova-compute[75288]: FIRMWARE:
Nov 10 22:44:45 user nova-compute[75288]: No targets found.
Nov 10 22:44:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:44:45 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:44:45 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad4b21-69e0-4873-8d8a-9f8481752547]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f6c8b4-e9ad-48d3-aa16-fa86270c9e6f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:45 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:45 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:45 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f (non-flash)
Nov 10 22:44:45 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b20117400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c112fd9-117c-404f-9334-dc61926c4d62]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dabfbe-d6e1-443e-adbd-763827ebcc1a]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3fd471-b799-4270-9b76-b103a0b2f84e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[73152868-a3f9-421a-8e5b-ba904ab8da7b]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f549ed4-ef66-45ac-a97d-ed6a81bd8b7e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02121108-9dde-4cc2-a4f1-79d2b8268a70]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260]
Nov 10 22:44:45 user nova-compute[75288]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f, portal: 172.16.0.220,3260] successful.
Nov 10 22:44:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382b1889-1dfe-4beb-a15c-c1848b180a3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24b4f30-c6b1-4693-93f7-4b407fbf9835]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] <== disconnect_volume: return (398ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:44:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0aito5hc/64e7f138d14c4075aa0b386c6928f4c7.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5bce81d0-809c-4c80-8740-c0277d7a290d', 'attached_at': '', 'detached_at': '', 'volume_id': '82fccb8c-c07d-447d-bc1f-85b71991ec14', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 22:44:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] swap_volume: removing Cinder connection for volume 382b1889-1dfe-4beb-a15c-c1848b180a3f {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 22:44:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0aito5hc/64e7f138d14c4075aa0b386c6928f4c7.delta 1073741824" returned: 0 in 0.054s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 22:44:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] swap_volume: Updating volume 382b1889-1dfe-4beb-a15c-c1848b180a3f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "LyetphaS", "auth_password": "wb4fq9MmoxB65s", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "82fccb8c-c07d-447d-bc1f-85b71991ec14"}, "status": "reserved", "instance": "5bce81d0-809c-4c80-8740-c0277d7a290d", "attached_at": "", "detached_at": "", "volume_id": "82fccb8c-c07d-447d-bc1f-85b71991ec14", "serial": "82fccb8c-c07d-447d-bc1f-85b71991ec14"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '82fccb8c-c07d-447d-bc1f-85b71991ec14', 'no_device': None, 'attachment_id': '0f54d4dd-a2a6-4da0-b657-46fd07c17423'} {{(pid=75288) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 22:44:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b605d4fc-1122-49c5-be28-dbd230594bcd tempest-TestVolumeSwap-889180773 tempest-TestVolumeSwap-889180773-project-admin] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 34.692s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:44:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 22:44:47 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:44:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0aito5hc/64e7f138d14c4075aa0b386c6928f4c7.delta /opt/stack/data/nova/instances/snapshots/tmp0aito5hc/64e7f138d14c4075aa0b386c6928f4c7 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0aito5hc/64e7f138d14c4075aa0b386c6928f4c7.delta /opt/stack/data/nova/instances/snapshots/tmp0aito5hc/64e7f138d14c4075aa0b386c6928f4c7" returned: 0 in 0.427s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Snapshot extracted, beginning image upload
Nov 10 22:44:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:48 user nova-compute[75288]: INFO nova.compute.manager [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Detaching volume 82fccb8c-c07d-447d-bc1f-85b71991ec14
Nov 10 22:44:48 user nova-compute[75288]: INFO nova.virt.block_device [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Attempting to driver detach volume 82fccb8c-c07d-447d-bc1f-85b71991ec14 from mountpoint /dev/vdb
Nov 10 22:44:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Attempting to detach device vdb from instance 5bce81d0-809c-4c80-8740-c0277d7a290d from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:44:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:44:48 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:44:48 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:44:48 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:44:48 user nova-compute[75288]:   <serial>82fccb8c-c07d-447d-bc1f-85b71991ec14</serial>
Nov 10 22:44:48 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:44:48 user nova-compute[75288]: </disk>
Nov 10 22:44:48 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:44:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Successfully detached device vdb from instance 5bce81d0-809c-4c80-8740-c0277d7a290d from the persistent domain config.
Nov 10 22:44:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bce81d0-809c-4c80-8740-c0277d7a290d from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:44:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:44:48 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:44:48 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:44:48 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:44:48 user nova-compute[75288]:   <serial>82fccb8c-c07d-447d-bc1f-85b71991ec14</serial>
Nov 10 22:44:48 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:44:48 user nova-compute[75288]: </disk>
Nov 10 22:44:48 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:44:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:44:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Snapshot image upload complete
Nov 10 22:44:50 user nova-compute[75288]: INFO nova.compute.manager [None req-8fb6b207-4044-468e-962b-bee5f0c7b587 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Took 5.45 seconds to snapshot the instance on the hypervisor.
Nov 10 22:44:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:51 user nova-compute[75288]: INFO nova.compute.manager [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Rescuing
Nov 10 22:44:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquired lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updating instance_info_cache with network_info: [{"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Releasing lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-79505f68-c872-4601-b116-b587b97979df req-c12b54f6-2481-4064-bbe0-f03d5358614f service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-79505f68-c872-4601-b116-b587b97979df req-c12b54f6-2481-4064-bbe0-f03d5358614f service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-79505f68-c872-4601-b116-b587b97979df req-c12b54f6-2481-4064-bbe0-f03d5358614f service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-79505f68-c872-4601-b116-b587b97979df req-c12b54f6-2481-4064-bbe0-f03d5358614f service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-79505f68-c872-4601-b116-b587b97979df req-c12b54f6-2481-4064-bbe0-f03d5358614f service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:52 user nova-compute[75288]: WARNING nova.compute.manager [req-79505f68-c872-4601-b116-b587b97979df req-c12b54f6-2481-4064-bbe0-f03d5358614f service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state active and task_state rescuing.
Nov 10 22:44:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:44:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance destroyed successfully.
Nov 10 22:44:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Attempting a stable device rescue
Nov 10 22:44:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 22:44:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Creating image(s)
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "/opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "/opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "bfcac65bb3b3ef22a9927655b0353458f63be8e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "bfcac65bb3b3ef22a9927655b0353458f63be8e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:44:53 user nova-compute[75288]: INFO nova.compute.claims [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Claim successful on node user
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.virt.images [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] 87bc2d8d-1387-4e60-a02c-cc321d54fbbe was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.part /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.part /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.converted" returned: 0 in 0.262s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.447s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "bfcac65bb3b3ef22a9927655b0353458f63be8e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.493s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "bfcac65bb3b3ef22a9927655b0353458f63be8e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "bfcac65bb3b3ef22a9927655b0353458f63be8e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-8714b9cc-9ec1-496b-8a12-946b1658c1b6 req-cd20a3ee-e7cd-4702-860b-637ba09f9322 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8714b9cc-9ec1-496b-8a12-946b1658c1b6 req-cd20a3ee-e7cd-4702-860b-637ba09f9322 service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8714b9cc-9ec1-496b-8a12-946b1658c1b6 req-cd20a3ee-e7cd-4702-860b-637ba09f9322 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8714b9cc-9ec1-496b-8a12-946b1658c1b6 req-cd20a3ee-e7cd-4702-860b-637ba09f9322 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-8714b9cc-9ec1-496b-8a12-946b1658c1b6 req-cd20a3ee-e7cd-4702-860b-637ba09f9322 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:54 user nova-compute[75288]: WARNING nova.compute.manager [req-8714b9cc-9ec1-496b-8a12-946b1658c1b6 req-cd20a3ee-e7cd-4702-860b-637ba09f9322 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state active and task_state rescuing.
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:44:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.policy [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '824744a11e9d4e4d9095fb0558632e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f4e0a73b542a8a78c748a4d1c5914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7 --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7,backing_fmt=raw /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:44:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Creating image(s)
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "/opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "/opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "/opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7,backing_fmt=raw /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue" returned: 0 in 0.070s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "bfcac65bb3b3ef22a9927655b0353458f63be8e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'migration_context' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.objects.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Object Instance<7b99fd44-d683-43c8-9de4-1cc73e15cc9f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Start _get_guest_xml network_info=[{"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "vif_mac": "fa:16:3e:ef:23:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '87bc2d8d-1387-4e60-a02c-cc321d54fbbe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMIyhDRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7b99fd44-d683-43c8-9de4-1cc73e15cc9f', 'attached_at': '', 'detached_at': '', 'volume_id': '9dae92f4-19fc-4363-8255-72bb93d68bda', 'serial': '9dae92f4-19fc-4363-8255-72bb93d68bda'}, 'mount_device': '/dev/vda', 'attachment_id': '4f27f930-8bb5-4a11-b1a8-bdd78c6b4bc2', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'resources' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.objects.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Object Instance<7b99fd44-d683-43c8-9de4-1cc73e15cc9f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.objects.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Object Instance<7b99fd44-d683-43c8-9de4-1cc73e15cc9f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:44:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:44:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Successfully created port: 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.objects.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Object Instance<7b99fd44-d683-43c8-9de4-1cc73e15cc9f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMIyhDRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:44:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:44:56 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1d6b3-87cf-4632-9156-a9d4d6642a79]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NMIyhDRs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 22:44:56 user nova-compute[75288]: node.name = iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:44:56 user nova-compute[75288]: node.tpgt = -1
Nov 10 22:44:56 user nova-compute[75288]: node.startup = automatic
Nov 10 22:44:56 user nova-compute[75288]: node.leading_login = No
Nov 10 22:44:56 user nova-compute[75288]: iface.iscsi_ifacename = default
Nov 10 22:44:56 user nova-compute[75288]: iface.net_ifacename = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.ipaddress = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.prefix_len = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.hwaddress = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.transport_name = tcp
Nov 10 22:44:56 user nova-compute[75288]: iface.initiatorname = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.state = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.vlan_id = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.vlan_priority = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.vlan_state = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.iface_num = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.mtu = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.port = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.bootproto = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.subnet_mask = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.gateway = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_alt_client_id = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_dns = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_learn_iqn = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_vendor_id_state = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_vendor_id = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.dhcp_slp_da = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.fragmentation = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.gratuitous_arp = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.incoming_forwarding = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.tos_state = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.tos = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.ttl = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.delayed_ack = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.tcp_nagle = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.tcp_wsf_state = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.tcp_wsf = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.tcp_timer_scale = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.tcp_timestamp = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.redirect = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.def_task_mgmt_timeout = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.header_digest = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.data_digest = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.immediate_data = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.initial_r2t = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.data_seq_inorder = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.data_pdu_inorder = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.erl = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.max_receive_data_len = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.first_burst_len = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.max_outstanding_r2t = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.max_burst_len = 0
Nov 10 22:44:56 user nova-compute[75288]: iface.chap_auth = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.bidi_chap = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.strict_login_compliance = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.discovery_auth = <empty>
Nov 10 22:44:56 user nova-compute[75288]: iface.discovery_logout = <empty>
Nov 10 22:44:56 user nova-compute[75288]: node.discovery_address = <empty>
Nov 10 22:44:56 user nova-compute[75288]: node.discovery_port = 0
Nov 10 22:44:56 user nova-compute[75288]: node.discovery_type = static
Nov 10 22:44:56 user nova-compute[75288]: node.session.initial_cmdsn = 0
Nov 10 22:44:56 user nova-compute[75288]: node.session.initial_login_retry_max = 8
Nov 10 22:44:56 user nova-compute[75288]: node.session.xmit_thread_priority = -20
Nov 10 22:44:56 user nova-compute[75288]: node.session.cmds_max = 128
Nov 10 22:44:56 user nova-compute[75288]: node.session.queue_depth = 32
Nov 10 22:44:56 user nova-compute[75288]: node.session.nr_sessions = 1
Nov 10 22:44:56 user nova-compute[75288]: node.session.auth.authmethod = CHAP
Nov 10 22:44:56 user nova-compute[75288]: node.session.auth.username = NMIyhDRs
Nov 10 22:44:56 user nova-compute[75288]: node.session.auth.password = ***
Nov 10 22:44:56 user nova-compute[75288]: node.session.auth.username_in = <empty>
Nov 10 22:44:56 user nova-compute[75288]: node.session.auth.password_in = <empty>
Nov 10 22:44:56 user nova-compute[75288]: node.session.auth.chap_algs = MD5
Nov 10 22:44:56 user nova-compute[75288]: node.session.timeo.replacement_timeout = 120
Nov 10 22:44:56 user nova-compute[75288]: node.session.err_timeo.abort_timeout = 15
Nov 10 22:44:56 user nova-compute[75288]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 22:44:56 user nova-compute[75288]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 22:44:56 user nova-compute[75288]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.FastAbort = Yes
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.InitialR2T = No
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.ImmediateData = Yes
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.MaxConnections = 1
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 22:44:56 user nova-compute[75288]: node.session.iscsi.ERL = 0
Nov 10 22:44:56 user nova-compute[75288]: node.session.scan = manual
Nov 10 22:44:56 user nova-compute[75288]: node.session.reopen_max = 0
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].address = 172.16.0.220
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].port = 3260
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].startup = manual
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].tcp.window_size = 524288
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].tcp.type_of_service = 0
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].timeo.logout_timeout = 15
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].timeo.login_timeout = 15
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].timeo.auth_timeout = 45
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].iscsi.DataDigest = None
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].iscsi.IFMarker = No
Nov 10 22:44:56 user nova-compute[75288]: node.conn[0].iscsi.OFMarker = No
Nov 10 22:44:56 user nova-compute[75288]: # END RECORD
Nov 10 22:44:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[73126dfe-cce6-4a91-898f-02649dd5974f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[79758727-25ef-487f-af10-a7f4115a47d8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMIyhDRs {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.images [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] ab52a32b-6403-4d4d-bdc8-520a11121881 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.part /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMIyhDRs" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55f1710-3a59-42fd-be54-ee1fb9a87ffe]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NMIyhDRs'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f92e4c-bcb1-4cc9-a6bd-51f61d86c547]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f6f79-d5b2-49cc-bef6-71645dff3ddb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:56 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:44:56 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:44:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.182s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] HCTL ('34', '0', '0', 0) found on session 15 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9edf6d-5c2e-430b-b6a4-46cb20725917]: (4, ('0 0 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Searching for a device in session 15 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMIyhDRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.214s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] <== connect_volume: return (215ms) {'type': 'block', 'scsi_wwn': '23861376333356431', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861376333356431', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-827809454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-827809454',id=20,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:43:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-1otxj820',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:43:02Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=7b99fd44-d683-43c8-9de4-1cc73e15cc9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "vif_mac": "fa:16:3e:ef:23:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "vif_mac": "fa:16:3e:ef:23:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.objects.base [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Object Instance<7b99fd44-d683-43c8-9de4-1cc73e15cc9f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:44:56 user nova-compute[75288]:   <uuid>7b99fd44-d683-43c8-9de4-1cc73e15cc9f</uuid>
Nov 10 22:44:56 user nova-compute[75288]:   <name>instance-00000014</name>
Nov 10 22:44:56 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:44:56 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:44:56 user nova-compute[75288]:   <metadata>
Nov 10 22:44:56 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:44:56 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:44:56 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-827809454</nova:name>
Nov 10 22:44:56 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:44:55</nova:creationTime>
Nov 10 22:44:56 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:44:56 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:44:56 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:44:56 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:44:56 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:44:56 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:44:56 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:44:56 user nova-compute[75288]:       <nova:owner>
Nov 10 22:44:56 user nova-compute[75288]:         <nova:user uuid="07d1ae0425e64057b3b2220d4bb02624">tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member</nova:user>
Nov 10 22:44:56 user nova-compute[75288]:         <nova:project uuid="4325393aa3434c2a87912895d4574812">tempest-ServerBootFromVolumeStableRescueTest-244383607</nova:project>
Nov 10 22:44:56 user nova-compute[75288]:       </nova:owner>
Nov 10 22:44:56 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:44:56 user nova-compute[75288]:       <nova:ports>
Nov 10 22:44:56 user nova-compute[75288]:         <nova:port uuid="a5dd02b7-0e66-4753-adbc-5ac057ce4fad">
Nov 10 22:44:56 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 22:44:56 user nova-compute[75288]:         </nova:port>
Nov 10 22:44:56 user nova-compute[75288]:       </nova:ports>
Nov 10 22:44:56 user nova-compute[75288]:     </nova:instance>
Nov 10 22:44:56 user nova-compute[75288]:   </metadata>
Nov 10 22:44:56 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:44:56 user nova-compute[75288]:     <system>
Nov 10 22:44:56 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:44:56 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:44:56 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:44:56 user nova-compute[75288]:       <entry name="serial">7b99fd44-d683-43c8-9de4-1cc73e15cc9f</entry>
Nov 10 22:44:56 user nova-compute[75288]:       <entry name="uuid">7b99fd44-d683-43c8-9de4-1cc73e15cc9f</entry>
Nov 10 22:44:56 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:44:56 user nova-compute[75288]:     </system>
Nov 10 22:44:56 user nova-compute[75288]:   </sysinfo>
Nov 10 22:44:56 user nova-compute[75288]:   <os>
Nov 10 22:44:56 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:44:56 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:44:56 user nova-compute[75288]:   </os>
Nov 10 22:44:56 user nova-compute[75288]:   <features>
Nov 10 22:44:56 user nova-compute[75288]:     <acpi/>
Nov 10 22:44:56 user nova-compute[75288]:     <apic/>
Nov 10 22:44:56 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:44:56 user nova-compute[75288]:   </features>
Nov 10 22:44:56 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:44:56 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:44:56 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:44:56 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:44:56 user nova-compute[75288]:   </clock>
Nov 10 22:44:56 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:44:56 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:44:56 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:44:56 user nova-compute[75288]:   </cpu>
Nov 10 22:44:56 user nova-compute[75288]:   <devices>
Nov 10 22:44:56 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:44:56 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:44:56 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Nov 10 22:44:56 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:44:56 user nova-compute[75288]:       <serial>9dae92f4-19fc-4363-8255-72bb93d68bda</serial>
Nov 10 22:44:56 user nova-compute[75288]:     </disk>
Nov 10 22:44:56 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:44:56 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:44:56 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue"/>
Nov 10 22:44:56 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:44:56 user nova-compute[75288]:       <boot order="1"/>
Nov 10 22:44:56 user nova-compute[75288]:     </disk>
Nov 10 22:44:56 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:44:56 user nova-compute[75288]:       <mac address="fa:16:3e:ef:23:84"/>
Nov 10 22:44:56 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:56 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:44:56 user nova-compute[75288]:       <target dev="tapa5dd02b7-0e"/>
Nov 10 22:44:56 user nova-compute[75288]:     </interface>
Nov 10 22:44:56 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:44:56 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/console.log" append="off"/>
Nov 10 22:44:56 user nova-compute[75288]:     </serial>
Nov 10 22:44:56 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:44:56 user nova-compute[75288]:     <video>
Nov 10 22:44:56 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:56 user nova-compute[75288]:     </video>
Nov 10 22:44:56 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:44:56 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:44:56 user nova-compute[75288]:     </rng>
Nov 10 22:44:56 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:44:56 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:44:56 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:44:56 user nova-compute[75288]:     </memballoon>
Nov 10 22:44:56 user nova-compute[75288]:   </devices>
Nov 10 22:44:56 user nova-compute[75288]: </domain>
Nov 10 22:44:56 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.part /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.converted" returned: 0 in 0.238s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance destroyed successfully.
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] No VIF found with MAC fa:16:3e:ef:23:84, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.689s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07 --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Successfully updated port: 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquired lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-changed-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Refreshing instance network info cache due to event network-changed-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] Acquiring lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07 --force-share --output=json" returned: 0 in 0.240s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07,backing_fmt=raw /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07,backing_fmt=raw /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk 1073741824" returned: 0 in 0.068s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07 --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Ensure instance console log exists: /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updating instance_info_cache with network_info: [{"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Releasing lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Instance network_info: |[{"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] Acquired lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Refreshing network info cache for port 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Start _get_guest_xml network_info=[{"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7c986c56101f198d34d2b815ce49e396',container_format='bare',created_at=2023-11-10T22:44:45Z,direct_url=<?>,disk_format='qcow2',id=ab52a32b-6403-4d4d-bdc8-520a11121881,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1252278382',owner='3f2f4e0a73b542a8a78c748a4d1c5914',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T22:44:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'ab52a32b-6403-4d4d-bdc8-520a11121881'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:44:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7c986c56101f198d34d2b815ce49e396',container_format='bare',created_at=2023-11-10T22:44:45Z,direct_url=<?>,disk_format='qcow2',id=ab52a32b-6403-4d4d-bdc8-520a11121881,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1252278382',owner='3f2f4e0a73b542a8a78c748a4d1c5914',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T22:44:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-958957965',display_name='tempest-TestStampPattern-server-958957965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-958957965',id=24,image_ref='ab52a32b-6403-4d4d-bdc8-520a11121881',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhOyHQ/mMcppCwCJUcBtZB9RAsC8DcDZYbZel44qDgENac/guD67yMkwHCAMOuJ/b/WnIA9XMdWVs2PHqnRCV/vU+mu+EYcKal9GrSkHUYouqZemEhNE4qY9vOyDF7nA==',key_name='tempest-TestStampPattern-1399113466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f2f4e0a73b542a8a78c748a4d1c5914',ramdisk_id='',reservation_id='r-9ablp93i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='70c0e693-25bf-45bb-80b8-a3829e58a067',image_min_disk='1',image_min_ram='0',image_owner_id='3f2f4e0a73b542a8a78c748a4d1c5914',image_owner_project_name='tempest-TestStampPattern-2137207160',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2137207160-project-member',image_user_id='824744a11e9d4e4d9095fb0558632e00',network_allocated='True',owner_project_name='tempest-TestStampPattern-2137207160',owner_user_name='tempest-TestStampPattern-2137207160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:44:55Z,user_data=None,user_id='824744a11e9d4e4d9095fb0558632e00',uuid=53c5e477-fbbc-416b-848c-c3afe9d2a1af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converting VIF {"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:85:f0,bridge_name='br-int',has_traffic_filtering=True,id=197ddcca-4bb3-423d-ab94-f43c9ae0f3f6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ddcca-4b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'pci_devices' on Instance uuid 53c5e477-fbbc-416b-848c-c3afe9d2a1af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:44:57 user nova-compute[75288]:   <uuid>53c5e477-fbbc-416b-848c-c3afe9d2a1af</uuid>
Nov 10 22:44:57 user nova-compute[75288]:   <name>instance-00000018</name>
Nov 10 22:44:57 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:44:57 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:44:57 user nova-compute[75288]:   <metadata>
Nov 10 22:44:57 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:44:57 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:44:57 user nova-compute[75288]:       <nova:name>tempest-TestStampPattern-server-958957965</nova:name>
Nov 10 22:44:57 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:44:57</nova:creationTime>
Nov 10 22:44:57 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:44:57 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:44:57 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:44:57 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:44:57 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:44:57 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:44:57 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:44:57 user nova-compute[75288]:       <nova:owner>
Nov 10 22:44:57 user nova-compute[75288]:         <nova:user uuid="824744a11e9d4e4d9095fb0558632e00">tempest-TestStampPattern-2137207160-project-member</nova:user>
Nov 10 22:44:57 user nova-compute[75288]:         <nova:project uuid="3f2f4e0a73b542a8a78c748a4d1c5914">tempest-TestStampPattern-2137207160</nova:project>
Nov 10 22:44:57 user nova-compute[75288]:       </nova:owner>
Nov 10 22:44:57 user nova-compute[75288]:       <nova:root type="image" uuid="ab52a32b-6403-4d4d-bdc8-520a11121881"/>
Nov 10 22:44:57 user nova-compute[75288]:       <nova:ports>
Nov 10 22:44:57 user nova-compute[75288]:         <nova:port uuid="197ddcca-4bb3-423d-ab94-f43c9ae0f3f6">
Nov 10 22:44:57 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:44:57 user nova-compute[75288]:         </nova:port>
Nov 10 22:44:57 user nova-compute[75288]:       </nova:ports>
Nov 10 22:44:57 user nova-compute[75288]:     </nova:instance>
Nov 10 22:44:57 user nova-compute[75288]:   </metadata>
Nov 10 22:44:57 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:44:57 user nova-compute[75288]:     <system>
Nov 10 22:44:57 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:44:57 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:44:57 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:44:57 user nova-compute[75288]:       <entry name="serial">53c5e477-fbbc-416b-848c-c3afe9d2a1af</entry>
Nov 10 22:44:57 user nova-compute[75288]:       <entry name="uuid">53c5e477-fbbc-416b-848c-c3afe9d2a1af</entry>
Nov 10 22:44:57 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:44:57 user nova-compute[75288]:     </system>
Nov 10 22:44:57 user nova-compute[75288]:   </sysinfo>
Nov 10 22:44:57 user nova-compute[75288]:   <os>
Nov 10 22:44:57 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:44:57 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:44:57 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:44:57 user nova-compute[75288]:   </os>
Nov 10 22:44:57 user nova-compute[75288]:   <features>
Nov 10 22:44:57 user nova-compute[75288]:     <acpi/>
Nov 10 22:44:57 user nova-compute[75288]:     <apic/>
Nov 10 22:44:57 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:44:57 user nova-compute[75288]:   </features>
Nov 10 22:44:57 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:44:57 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:44:57 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:44:57 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:44:57 user nova-compute[75288]:   </clock>
Nov 10 22:44:57 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:44:57 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:44:57 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:44:57 user nova-compute[75288]:   </cpu>
Nov 10 22:44:57 user nova-compute[75288]:   <devices>
Nov 10 22:44:57 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:44:57 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:44:57 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk"/>
Nov 10 22:44:57 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:44:57 user nova-compute[75288]:     </disk>
Nov 10 22:44:57 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:44:57 user nova-compute[75288]:       <mac address="fa:16:3e:db:85:f0"/>
Nov 10 22:44:57 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:57 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:44:57 user nova-compute[75288]:       <target dev="tap197ddcca-4b"/>
Nov 10 22:44:57 user nova-compute[75288]:     </interface>
Nov 10 22:44:57 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:44:57 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/console.log" append="off"/>
Nov 10 22:44:57 user nova-compute[75288]:     </serial>
Nov 10 22:44:57 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:44:57 user nova-compute[75288]:     <video>
Nov 10 22:44:57 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:44:57 user nova-compute[75288]:     </video>
Nov 10 22:44:57 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:44:57 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:44:57 user nova-compute[75288]:     </rng>
Nov 10 22:44:57 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:44:57 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:44:57 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:44:57 user nova-compute[75288]:     </memballoon>
Nov 10 22:44:57 user nova-compute[75288]:   </devices>
Nov 10 22:44:57 user nova-compute[75288]: </domain>
Nov 10 22:44:57 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-958957965',display_name='tempest-TestStampPattern-server-958957965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-958957965',id=24,image_ref='ab52a32b-6403-4d4d-bdc8-520a11121881',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhOyHQ/mMcppCwCJUcBtZB9RAsC8DcDZYbZel44qDgENac/guD67yMkwHCAMOuJ/b/WnIA9XMdWVs2PHqnRCV/vU+mu+EYcKal9GrSkHUYouqZemEhNE4qY9vOyDF7nA==',key_name='tempest-TestStampPattern-1399113466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f2f4e0a73b542a8a78c748a4d1c5914',ramdisk_id='',reservation_id='r-9ablp93i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='70c0e693-25bf-45bb-80b8-a3829e58a067',image_min_disk='1',image_min_ram='0',image_owner_id='3f2f4e0a73b542a8a78c748a4d1c5914',image_owner_project_name='tempest-TestStampPattern-2137207160',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2137207160-project-member',image_user_id='824744a11e9d4e4d9095fb0558632e00',network_allocated='True',owner_project_name='tempest-TestStampPattern-2137207160',owner_user_name='tempest-TestStampPattern-2137207160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:44:55Z,user_data=None,user_id='824744a11e9d4e4d9095fb0558632e00',uuid=53c5e477-fbbc-416b-848c-c3afe9d2a1af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converting VIF {"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:85:f0,bridge_name='br-int',has_traffic_filtering=True,id=197ddcca-4bb3-423d-ab94-f43c9ae0f3f6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ddcca-4b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG os_vif [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:85:f0,bridge_name='br-int',has_traffic_filtering=True,id=197ddcca-4bb3-423d-ab94-f43c9ae0f3f6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ddcca-4b') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0d1373e-be97-5ef2-81b5-c54589f4209a', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap197ddcca-4b, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap197ddcca-4b, col_values=(('qos', UUID('76e41930-79af-448f-a197-30487afacca1')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap197ddcca-4b, col_values=(('external_ids', {'iface-id': '197ddcca-4bb3-423d-ab94-f43c9ae0f3f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:85:f0', 'vm-uuid': '53c5e477-fbbc-416b-848c-c3afe9d2a1af'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: INFO os_vif [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:85:f0,bridge_name='br-int',has_traffic_filtering=True,id=197ddcca-4bb3-423d-ab94-f43c9ae0f3f6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ddcca-4b')
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No VIF found with MAC fa:16:3e:db:85:f0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updated VIF entry in instance network info cache for port 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updating instance_info_cache with network_info: [{"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7aa3137a-bf34-4e26-83ea-36b137afae16 req-ae53e662-23ff-4d55-9219-661afe717e19 service nova] Releasing lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-182462b6-96bc-4158-b13a-0f65c9f30082 req-d9450695-0f6e-4d19-9307-1c0f7ef19a55 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-182462b6-96bc-4158-b13a-0f65c9f30082 req-d9450695-0f6e-4d19-9307-1c0f7ef19a55 service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-182462b6-96bc-4158-b13a-0f65c9f30082 req-d9450695-0f6e-4d19-9307-1c0f7ef19a55 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-182462b6-96bc-4158-b13a-0f65c9f30082 req-d9450695-0f6e-4d19-9307-1c0f7ef19a55 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-182462b6-96bc-4158-b13a-0f65c9f30082 req-d9450695-0f6e-4d19-9307-1c0f7ef19a55 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:58 user nova-compute[75288]: WARNING nova.compute.manager [req-182462b6-96bc-4158-b13a-0f65c9f30082 req-d9450695-0f6e-4d19-9307-1c0f7ef19a55 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state active and task_state rescuing.
Nov 10 22:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-e1e32933-4334-4662-ba85-75118b71c93d req-dbd4d14b-4adc-4039-8ba6-db20f740cb6c service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e1e32933-4334-4662-ba85-75118b71c93d req-dbd4d14b-4adc-4039-8ba6-db20f740cb6c service nova] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e1e32933-4334-4662-ba85-75118b71c93d req-dbd4d14b-4adc-4039-8ba6-db20f740cb6c service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e1e32933-4334-4662-ba85-75118b71c93d req-dbd4d14b-4adc-4039-8ba6-db20f740cb6c service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:44:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-e1e32933-4334-4662-ba85-75118b71c93d req-dbd4d14b-4adc-4039-8ba6-db20f740cb6c service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] No waiting events found dispatching network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:44:59 user nova-compute[75288]: WARNING nova.compute.manager [req-e1e32933-4334-4662-ba85-75118b71c93d req-dbd4d14b-4adc-4039-8ba6-db20f740cb6c service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received unexpected event network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 for instance with vm_state building and task_state spawning.
Nov 10 22:44:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-8f12fd4c-b080-4083-925f-cf4a9695486a req-2969d30d-a7d7-4df4-a240-4b6011dbe130 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f12fd4c-b080-4083-925f-cf4a9695486a req-2969d30d-a7d7-4df4-a240-4b6011dbe130 service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f12fd4c-b080-4083-925f-cf4a9695486a req-2969d30d-a7d7-4df4-a240-4b6011dbe130 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f12fd4c-b080-4083-925f-cf4a9695486a req-2969d30d-a7d7-4df4-a240-4b6011dbe130 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-8f12fd4c-b080-4083-925f-cf4a9695486a req-2969d30d-a7d7-4df4-a240-4b6011dbe130 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:00 user nova-compute[75288]: WARNING nova.compute.manager [req-8f12fd4c-b080-4083-925f-cf4a9695486a req-2969d30d-a7d7-4df4-a240-4b6011dbe130 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state active and task_state rescuing.
Nov 10 22:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f681ff1e-487a-42d5-b540-f3c45f08af7a tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-15aec9c7-f33b-4364-b100-aea0bf564874 req-545a5136-1c59-4e52-ac50-a2a3eb82c626 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15aec9c7-f33b-4364-b100-aea0bf564874 req-545a5136-1c59-4e52-ac50-a2a3eb82c626 service nova] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15aec9c7-f33b-4364-b100-aea0bf564874 req-545a5136-1c59-4e52-ac50-a2a3eb82c626 service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15aec9c7-f33b-4364-b100-aea0bf564874 req-545a5136-1c59-4e52-ac50-a2a3eb82c626 service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-15aec9c7-f33b-4364-b100-aea0bf564874 req-545a5136-1c59-4e52-ac50-a2a3eb82c626 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] No waiting events found dispatching network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:01 user nova-compute[75288]: WARNING nova.compute.manager [req-15aec9c7-f33b-4364-b100-aea0bf564874 req-545a5136-1c59-4e52-ac50-a2a3eb82c626 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received unexpected event network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 for instance with vm_state building and task_state spawning.
Nov 10 22:45:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:45:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:45:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Instance spawned successfully.
Nov 10 22:45:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:45:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:02 user nova-compute[75288]: INFO nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Took 7.56 seconds to spawn the instance on the hypervisor.
Nov 10 22:45:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:45:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:02 user nova-compute[75288]: INFO nova.compute.manager [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Took 9.41 seconds to build instance.
Nov 10 22:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-58fa09b3-b948-4c56-8af1-040a41d92f44 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.580s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:08 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5bce81d0-809c-4c80-8740-c0277d7a290d is timed out.
Nov 10 22:45:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Successfully detached device vdb from instance 5bce81d0-809c-4c80-8740-c0277d7a290d from the live domain config.
Nov 10 22:45:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyetphaS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '82fccb8c-c07d-447d-bc1f-85b71991ec14'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:45:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16cad7-d66f-4b75-b569-3e5d275a19e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:45:08 user nova-compute[75288]: No targets found.
Nov 10 22:45:08 user nova-compute[75288]: iSNS:
Nov 10 22:45:08 user nova-compute[75288]: No targets found.
Nov 10 22:45:08 user nova-compute[75288]: STATIC:
Nov 10 22:45:08 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:45:08 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:45:08 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:45:08 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14
Nov 10 22:45:08 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:45:08 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:45:08 user nova-compute[75288]: FIRMWARE:
Nov 10 22:45:08 user nova-compute[75288]: No targets found.
Nov 10 22:45:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:45:08 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:45:08 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf52764-f48a-4707-9578-c8d5c7d06ab5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5abe88-81cc-44d6-a258-e881570da7ea]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:45:08 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:45:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:45:08 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 (non-flash)
Nov 10 22:45:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10339120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c9ae45-dff0-4a72-96f8-69101a0bdf7b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3636a78-1806-47e7-b855-d3799de1f5de]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8111447c-0bc9-40d8-a250-69aaa53d2b4a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[910ea1d4-8943-4bcd-9b55-ba3af47bcb00]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ba8b9-0867-4aa8-ac2d-141a4f51ea23]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb683c2-3a12-4a52-938e-65eac06c79ad]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260]
Nov 10 22:45:09 user nova-compute[75288]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14, portal: 172.16.0.220,3260] successful.
Nov 10 22:45:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82fccb8c-c07d-447d-bc1f-85b71991ec14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d681d-6a03-4421-81a9-641010f8793e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] <== disconnect_volume: return (388ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:45:09 user nova-compute[75288]: INFO nova.compute.claims [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Claim successful on node user
Nov 10 22:45:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Starting finish_migration {{(pid=75288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 22:45:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 22:45:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Creating image(s)
Nov 10 22:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.238s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk. size=21474836480 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.831s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk 21474836480 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk 21474836480" returned: 0 in 0.059s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Ensure instance console log exists: /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Start _get_guest_xml network_info=[{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1367405680-network", "vif_mac": "fa:16:3e:4f:a7:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b9342997-048d-4f4f-a552-de76f2a0a444', 'attached_at': '2023-11-10T22:45:10.000000', 'detached_at': '', 'volume_id': '4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'serial': '4f3faf58-a34d-4eb7-b3cc-8ecd91584420'}, 'mount_device': '/dev/vdb', 'attachment_id': '209c3d14-e933-4b23-8f10-5dafb0e9132c', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:45:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lazy-loading 'flavor' on Instance uuid 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:10 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:10 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:45:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:45:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:45:10 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.policy [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1b51c6d64044e57b9afcc85619c88e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef52a00aba2b48d5904eda97ecc89861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95d091-4bbd-480a-8edc-a46ed2ae1fae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4ec935d8-4f1d-43ed-af37-bb36a8e759e1 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.446s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:45:10 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[80322506-5d9d-4c8e-a206-609490c5f451]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420] added
Nov 10 22:45:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34424a0a-c340-4406-be59-eb472ed1c55c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:45:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Creating image(s)
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "/opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "/opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "/opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[573c227b-8c09-4916-b312-d7e1abba89eb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBxmJSRy {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBxmJSRy" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d132d-4169-4d71-a088-edc11d76208e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBxmJSRy'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b04163b-05e5-4aa5-b0bb-29ae132faaa3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bfa4df-c13e-4338-a39d-915bb1ee8f8e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:45:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:45:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8f297-002b-49a2-adee-32a08224d88e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]
Nov 10 22:45:11 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.
Nov 10 22:45:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[98466dd1-e3f1-4a4c-a7c9-793638b16282]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92d274-2bd0-4573-819d-6c1c552e7059]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:45:11 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:45:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:45:11 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:45:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac890f55-9426-4ff6-bb02-8562284d1cf5]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk 1073741824" returned: 0 in 0.056s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Successfully created port: 1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.228s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Cannot resize image /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Ensure instance console log exists: /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23365633339663465', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365633339663465', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1763701259',display_name='tempest-ServerActionsTestOtherB-server-1763701259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1763701259',id=16,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuF/yviImHglYGIXiLmfbAvxX1/9/n49hx51CEU4vPIIK0cwYCFjIHSOmrYvu7mdk8fQPm8oJwZeKNCXTTt3FJg6Tq2wup2YgajWX6dwhMXP1Xwfv2hMNZnvwgRC226mA==',key_name='tempest-keypair-37753185',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:39:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='224fa7e9054147d4aa63826efaa17392',ramdisk_id='',reservation_id='r-hxndv4eh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594854393',owner_user_name='tempest-ServerActionsTestOtherB-594854393-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c5517f32c04ad498f307b9b89c6a45',uuid=b9342997-048d-4f4f-a552-de76f2a0a444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1367405680-network", "vif_mac": "fa:16:3e:4f:a7:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converting VIF {"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1367405680-network", "vif_mac": "fa:16:3e:4f:a7:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:45:12 user nova-compute[75288]:   <uuid>b9342997-048d-4f4f-a552-de76f2a0a444</uuid>
Nov 10 22:45:12 user nova-compute[75288]:   <name>instance-00000010</name>
Nov 10 22:45:12 user nova-compute[75288]:   <memory>2097152</memory>
Nov 10 22:45:12 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:45:12 user nova-compute[75288]:   <metadata>
Nov 10 22:45:12 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:45:12 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:45:12 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherB-server-1763701259</nova:name>
Nov 10 22:45:12 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:45:10</nova:creationTime>
Nov 10 22:45:12 user nova-compute[75288]:       <nova:flavor name="m1.small">
Nov 10 22:45:12 user nova-compute[75288]:         <nova:memory>2048</nova:memory>
Nov 10 22:45:12 user nova-compute[75288]:         <nova:disk>20</nova:disk>
Nov 10 22:45:12 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:45:12 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:45:12 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:45:12 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:45:12 user nova-compute[75288]:       <nova:owner>
Nov 10 22:45:12 user nova-compute[75288]:         <nova:user uuid="18c5517f32c04ad498f307b9b89c6a45">tempest-ServerActionsTestOtherB-594854393-project-member</nova:user>
Nov 10 22:45:12 user nova-compute[75288]:         <nova:project uuid="224fa7e9054147d4aa63826efaa17392">tempest-ServerActionsTestOtherB-594854393</nova:project>
Nov 10 22:45:12 user nova-compute[75288]:       </nova:owner>
Nov 10 22:45:12 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:45:12 user nova-compute[75288]:       <nova:ports>
Nov 10 22:45:12 user nova-compute[75288]:         <nova:port uuid="909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83">
Nov 10 22:45:12 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 22:45:12 user nova-compute[75288]:         </nova:port>
Nov 10 22:45:12 user nova-compute[75288]:       </nova:ports>
Nov 10 22:45:12 user nova-compute[75288]:     </nova:instance>
Nov 10 22:45:12 user nova-compute[75288]:   </metadata>
Nov 10 22:45:12 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:45:12 user nova-compute[75288]:     <system>
Nov 10 22:45:12 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:45:12 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:45:12 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:45:12 user nova-compute[75288]:       <entry name="serial">b9342997-048d-4f4f-a552-de76f2a0a444</entry>
Nov 10 22:45:12 user nova-compute[75288]:       <entry name="uuid">b9342997-048d-4f4f-a552-de76f2a0a444</entry>
Nov 10 22:45:12 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:45:12 user nova-compute[75288]:     </system>
Nov 10 22:45:12 user nova-compute[75288]:   </sysinfo>
Nov 10 22:45:12 user nova-compute[75288]:   <os>
Nov 10 22:45:12 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:45:12 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:45:12 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:45:12 user nova-compute[75288]:   </os>
Nov 10 22:45:12 user nova-compute[75288]:   <features>
Nov 10 22:45:12 user nova-compute[75288]:     <acpi/>
Nov 10 22:45:12 user nova-compute[75288]:     <apic/>
Nov 10 22:45:12 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:45:12 user nova-compute[75288]:   </features>
Nov 10 22:45:12 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:45:12 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:45:12 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:45:12 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:45:12 user nova-compute[75288]:   </clock>
Nov 10 22:45:12 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:45:12 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:45:12 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:45:12 user nova-compute[75288]:   </cpu>
Nov 10 22:45:12 user nova-compute[75288]:   <devices>
Nov 10 22:45:12 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:45:12 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:45:12 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk"/>
Nov 10 22:45:12 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:45:12 user nova-compute[75288]:     </disk>
Nov 10 22:45:12 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:45:12 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:45:12 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 22:45:12 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:45:12 user nova-compute[75288]:       <serial>4f3faf58-a34d-4eb7-b3cc-8ecd91584420</serial>
Nov 10 22:45:12 user nova-compute[75288]:     </disk>
Nov 10 22:45:12 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:45:12 user nova-compute[75288]:       <mac address="fa:16:3e:4f:a7:85"/>
Nov 10 22:45:12 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:45:12 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:45:12 user nova-compute[75288]:       <target dev="tap909c66a6-f3"/>
Nov 10 22:45:12 user nova-compute[75288]:     </interface>
Nov 10 22:45:12 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:45:12 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/console.log" append="off"/>
Nov 10 22:45:12 user nova-compute[75288]:     </serial>
Nov 10 22:45:12 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:45:12 user nova-compute[75288]:     <video>
Nov 10 22:45:12 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:45:12 user nova-compute[75288]:     </video>
Nov 10 22:45:12 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:45:12 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:45:12 user nova-compute[75288]:     </rng>
Nov 10 22:45:12 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:45:12 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:45:12 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:45:12 user nova-compute[75288]:     </memballoon>
Nov 10 22:45:12 user nova-compute[75288]:   </devices>
Nov 10 22:45:12 user nova-compute[75288]: </domain>
Nov 10 22:45:12 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1763701259',display_name='tempest-ServerActionsTestOtherB-server-1763701259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1763701259',id=16,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuF/yviImHglYGIXiLmfbAvxX1/9/n49hx51CEU4vPIIK0cwYCFjIHSOmrYvu7mdk8fQPm8oJwZeKNCXTTt3FJg6Tq2wup2YgajWX6dwhMXP1Xwfv2hMNZnvwgRC226mA==',key_name='tempest-keypair-37753185',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:39:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='224fa7e9054147d4aa63826efaa17392',ramdisk_id='',reservation_id='r-hxndv4eh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594854393',owner_user_name='tempest-ServerActionsTestOtherB-594854393-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:44:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c5517f32c04ad498f307b9b89c6a45',uuid=b9342997-048d-4f4f-a552-de76f2a0a444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1367405680-network", "vif_mac": "fa:16:3e:4f:a7:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converting VIF {"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1367405680-network", "vif_mac": "fa:16:3e:4f:a7:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG os_vif [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27cf2bca-cd1e-522f-bd5e-ecfb9676e2a2', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap909c66a6-f3, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap909c66a6-f3, col_values=(('qos', UUID('ab1a0f5b-868d-4966-87f5-282c7813b397')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap909c66a6-f3, col_values=(('external_ids', {'iface-id': '909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:a7:85', 'vm-uuid': 'b9342997-048d-4f4f-a552-de76f2a0a444'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:12 user nova-compute[75288]: INFO os_vif [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3')
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] No VIF found with MAC fa:16:3e:4f:a7:85, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Successfully updated port: 1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "refresh_cache-054f3333-ecb7-4705-9b83-1f42e6cb90fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquired lock "refresh_cache-054f3333-ecb7-4705-9b83-1f42e6cb90fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-changed-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Refreshing instance network info cache due to event network-changed-1d8e948c-f9fd-4917-b90d-799b5892fb01. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] Acquiring lock "refresh_cache-054f3333-ecb7-4705-9b83-1f42e6cb90fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:45:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Updating instance_info_cache with network_info: [{"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Releasing lock "refresh_cache-054f3333-ecb7-4705-9b83-1f42e6cb90fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Instance network_info: |[{"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] Acquired lock "refresh_cache-054f3333-ecb7-4705-9b83-1f42e6cb90fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Refreshing network info cache for port 1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Start _get_guest_xml network_info=[{"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:45:13 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:13 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1978425707',display_name='tempest-ServersNegativeTestJSON-server-1978425707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1978425707',id=25,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef52a00aba2b48d5904eda97ecc89861',ramdisk_id='',reservation_id='r-29hm9tq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-891085347',owner_user_name='tempest-ServersNegativeTestJSON-891085347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:45:11Z,user_data=None,user_id='b1b51c6d64044e57b9afcc85619c88e6',uuid=054f3333-ecb7-4705-9b83-1f42e6cb90fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converting VIF {"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b2:de,bridge_name='br-int',has_traffic_filtering=True,id=1d8e948c-f9fd-4917-b90d-799b5892fb01,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e948c-f9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lazy-loading 'pci_devices' on Instance uuid 054f3333-ecb7-4705-9b83-1f42e6cb90fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:45:13 user nova-compute[75288]:   <uuid>054f3333-ecb7-4705-9b83-1f42e6cb90fd</uuid>
Nov 10 22:45:13 user nova-compute[75288]:   <name>instance-00000019</name>
Nov 10 22:45:13 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:45:13 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:45:13 user nova-compute[75288]:   <metadata>
Nov 10 22:45:13 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:45:13 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:45:13 user nova-compute[75288]:       <nova:name>tempest-ServersNegativeTestJSON-server-1978425707</nova:name>
Nov 10 22:45:13 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:45:13</nova:creationTime>
Nov 10 22:45:13 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:45:13 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:45:13 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:45:13 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:45:13 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:45:13 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:45:13 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:45:13 user nova-compute[75288]:       <nova:owner>
Nov 10 22:45:13 user nova-compute[75288]:         <nova:user uuid="b1b51c6d64044e57b9afcc85619c88e6">tempest-ServersNegativeTestJSON-891085347-project-member</nova:user>
Nov 10 22:45:13 user nova-compute[75288]:         <nova:project uuid="ef52a00aba2b48d5904eda97ecc89861">tempest-ServersNegativeTestJSON-891085347</nova:project>
Nov 10 22:45:13 user nova-compute[75288]:       </nova:owner>
Nov 10 22:45:13 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:45:13 user nova-compute[75288]:       <nova:ports>
Nov 10 22:45:13 user nova-compute[75288]:         <nova:port uuid="1d8e948c-f9fd-4917-b90d-799b5892fb01">
Nov 10 22:45:13 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 22:45:13 user nova-compute[75288]:         </nova:port>
Nov 10 22:45:13 user nova-compute[75288]:       </nova:ports>
Nov 10 22:45:13 user nova-compute[75288]:     </nova:instance>
Nov 10 22:45:13 user nova-compute[75288]:   </metadata>
Nov 10 22:45:13 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:45:13 user nova-compute[75288]:     <system>
Nov 10 22:45:13 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:45:13 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:45:13 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:45:13 user nova-compute[75288]:       <entry name="serial">054f3333-ecb7-4705-9b83-1f42e6cb90fd</entry>
Nov 10 22:45:13 user nova-compute[75288]:       <entry name="uuid">054f3333-ecb7-4705-9b83-1f42e6cb90fd</entry>
Nov 10 22:45:13 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:45:13 user nova-compute[75288]:     </system>
Nov 10 22:45:13 user nova-compute[75288]:   </sysinfo>
Nov 10 22:45:13 user nova-compute[75288]:   <os>
Nov 10 22:45:13 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:45:13 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:45:13 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:45:13 user nova-compute[75288]:   </os>
Nov 10 22:45:13 user nova-compute[75288]:   <features>
Nov 10 22:45:13 user nova-compute[75288]:     <acpi/>
Nov 10 22:45:13 user nova-compute[75288]:     <apic/>
Nov 10 22:45:13 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:45:13 user nova-compute[75288]:   </features>
Nov 10 22:45:13 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:45:13 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:45:13 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:45:13 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:45:13 user nova-compute[75288]:   </clock>
Nov 10 22:45:13 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:45:13 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:45:13 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:45:13 user nova-compute[75288]:   </cpu>
Nov 10 22:45:13 user nova-compute[75288]:   <devices>
Nov 10 22:45:13 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:45:13 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:45:13 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk"/>
Nov 10 22:45:13 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:45:13 user nova-compute[75288]:     </disk>
Nov 10 22:45:13 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:45:13 user nova-compute[75288]:       <mac address="fa:16:3e:ae:b2:de"/>
Nov 10 22:45:13 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:45:13 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:45:13 user nova-compute[75288]:       <target dev="tap1d8e948c-f9"/>
Nov 10 22:45:13 user nova-compute[75288]:     </interface>
Nov 10 22:45:13 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:45:13 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/console.log" append="off"/>
Nov 10 22:45:13 user nova-compute[75288]:     </serial>
Nov 10 22:45:13 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:45:13 user nova-compute[75288]:     <video>
Nov 10 22:45:13 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:45:13 user nova-compute[75288]:     </video>
Nov 10 22:45:13 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:45:13 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:45:13 user nova-compute[75288]:     </rng>
Nov 10 22:45:13 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:45:13 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:45:13 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:45:13 user nova-compute[75288]:     </memballoon>
Nov 10 22:45:13 user nova-compute[75288]:   </devices>
Nov 10 22:45:13 user nova-compute[75288]: </domain>
Nov 10 22:45:13 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1978425707',display_name='tempest-ServersNegativeTestJSON-server-1978425707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1978425707',id=25,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef52a00aba2b48d5904eda97ecc89861',ramdisk_id='',reservation_id='r-29hm9tq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-891085347',owner_user_name='tempest-ServersNegativeTestJSON-891085347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:45:11Z,user_data=None,user_id='b1b51c6d64044e57b9afcc85619c88e6',uuid=054f3333-ecb7-4705-9b83-1f42e6cb90fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converting VIF {"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b2:de,bridge_name='br-int',has_traffic_filtering=True,id=1d8e948c-f9fd-4917-b90d-799b5892fb01,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e948c-f9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG os_vif [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b2:de,bridge_name='br-int',has_traffic_filtering=True,id=1d8e948c-f9fd-4917-b90d-799b5892fb01,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e948c-f9') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75390492-6ab7-52e0-aa95-1edbe7460016', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d8e948c-f9, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d8e948c-f9, col_values=(('qos', UUID('ee37298f-8b84-45b2-94ae-e8175d854cc6')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d8e948c-f9, col_values=(('external_ids', {'iface-id': '1d8e948c-f9fd-4917-b90d-799b5892fb01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:b2:de', 'vm-uuid': '054f3333-ecb7-4705-9b83-1f42e6cb90fd'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:13 user nova-compute[75288]: INFO os_vif [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b2:de,bridge_name='br-int',has_traffic_filtering=True,id=1d8e948c-f9fd-4917-b90d-799b5892fb01,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e948c-f9')
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] No VIF found with MAC fa:16:3e:ae:b2:de, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Updated VIF entry in instance network info cache for port 1d8e948c-f9fd-4917-b90d-799b5892fb01. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Updating instance_info_cache with network_info: [{"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b477a4a-07ce-4990-b249-b35eb62a1592 req-e77f9a75-cc52-411f-81f9-b68d4c7d8cc0 service nova] Releasing lock "refresh_cache-054f3333-ecb7-4705-9b83-1f42e6cb90fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-71bd8325-d400-40fc-8aff-37a42153ad8c req-36d735d9-5319-4cab-8855-8adf6426fe43 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71bd8325-d400-40fc-8aff-37a42153ad8c req-36d735d9-5319-4cab-8855-8adf6426fe43 service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71bd8325-d400-40fc-8aff-37a42153ad8c req-36d735d9-5319-4cab-8855-8adf6426fe43 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71bd8325-d400-40fc-8aff-37a42153ad8c req-36d735d9-5319-4cab-8855-8adf6426fe43 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-71bd8325-d400-40fc-8aff-37a42153ad8c req-36d735d9-5319-4cab-8855-8adf6426fe43 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:14 user nova-compute[75288]: WARNING nova.compute.manager [req-71bd8325-d400-40fc-8aff-37a42153ad8c req-36d735d9-5319-4cab-8855-8adf6426fe43 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state active and task_state resize_finish.
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:16 user nova-compute[75288]: WARNING nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state active and task_state resize_finish.
Nov 10 22:45:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] No waiting events found dispatching network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:16 user nova-compute[75288]: WARNING nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received unexpected event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 for instance with vm_state building and task_state spawning.
Nov 10 22:45:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] No waiting events found dispatching network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:16 user nova-compute[75288]: WARNING nova.compute.manager [req-e96d6613-31b3-4f95-8561-d78db48cae01 req-087bae3a-8f97-46c1-99e0-656aaa1f1a1d service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received unexpected event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 for instance with vm_state building and task_state spawning.
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:45:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance running successfully.
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Failed to set time: agent not configured {{(pid=75288) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-201f1b8e-b95b-491e-9e70-b3f504a835ed tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] finish_migration finished successfully. {{(pid=75288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:45:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Instance spawned successfully.
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:45:17 user nova-compute[75288]: INFO nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Took 7.19 seconds to spawn the instance on the hypervisor.
Nov 10 22:45:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:45:18 user nova-compute[75288]: INFO nova.compute.manager [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Took 8.50 seconds to build instance.
Nov 10 22:45:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-276f8a24-9025-4c3a-bcbd-7f7bae051ae4 tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.612s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 22:45:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:45:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:45:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:45:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:45:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:45:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:45:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:45:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7117MB free_disk=24.963871002197266GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Applying migration context for instance b9342997-048d-4f4f-a552-de76f2a0a444 as it has an incoming, in-progress migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d. Migration status is finished {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 22:45:29 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating resource usage from migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 33ebbf72-0319-4e06-af0c-cf1462053666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5bce81d0-809c-4c80-8740-c0277d7a290d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 054f3333-ecb7-4705-9b83-1f42e6cb90fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 22:45:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 22:45:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 22:45:30 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:45:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:45:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:45:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.033s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:45:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:38 user nova-compute[75288]: INFO nova.compute.manager [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Terminating instance
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:38 user nova-compute[75288]: INFO nova.compute.manager [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Terminating instance
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-3f885e42-3422-4d69-bccc-d315e7532cbf req-141c0c05-7d09-4e89-82eb-e53d56c1b1cc service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3f885e42-3422-4d69-bccc-d315e7532cbf req-141c0c05-7d09-4e89-82eb-e53d56c1b1cc service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3f885e42-3422-4d69-bccc-d315e7532cbf req-141c0c05-7d09-4e89-82eb-e53d56c1b1cc service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3f885e42-3422-4d69-bccc-d315e7532cbf req-141c0c05-7d09-4e89-82eb-e53d56c1b1cc service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-3f885e42-3422-4d69-bccc-d315e7532cbf req-141c0c05-7d09-4e89-82eb-e53d56c1b1cc service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-3f885e42-3422-4d69-bccc-d315e7532cbf req-141c0c05-7d09-4e89-82eb-e53d56c1b1cc service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-unplugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Instance destroyed successfully.
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'resources' on Instance uuid 33ebbf72-0319-4e06-af0c-cf1462053666 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953048792',display_name='tempest-AttachVolumeTestJSON-server-1953048792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953048792',id=5,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3vqfKUuiehw3TPL4D2ZiwyGjjh3p2XrKXtuJPpbje12S5FWL3jL2H7awZbEhDBNNmacZBTz1uCPM0eMiU6tUiFBSKKETAGEIxTcQC5uTGmMzZyeomXtPGlHu+Q3a5gKA==',key_name='tempest-keypair-916666614',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-zo2p3ft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=33ebbf72-0319-4e06-af0c-cf1462053666,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "a17af079-be58-40cc-a993-4d5304f20445", "address": "fa:16:3e:36:3b:c0", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17af079-be", "ovs_interfaceid": "a17af079-be58-40cc-a993-4d5304f20445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG os_vif [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa17af079-be, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=862eb27a-09f1-4896-93b7-7219352855af) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: INFO os_vif [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=a17af079-be58-40cc-a993-4d5304f20445,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17af079-be')
Nov 10 22:45:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Deleting instance files /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666_del
Nov 10 22:45:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Deletion of /opt/stack/data/nova/instances/33ebbf72-0319-4e06-af0c-cf1462053666_del complete
Nov 10 22:45:39 user nova-compute[75288]: INFO nova.compute.manager [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 10 22:45:39 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-db80d365-9096-4b63-a5e1-7f88aa6d8b09 req-6d7597eb-228b-418f-9fe1-fbbc5949a41f service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-vif-unplugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db80d365-9096-4b63-a5e1-7f88aa6d8b09 req-6d7597eb-228b-418f-9fe1-fbbc5949a41f service nova] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db80d365-9096-4b63-a5e1-7f88aa6d8b09 req-6d7597eb-228b-418f-9fe1-fbbc5949a41f service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db80d365-9096-4b63-a5e1-7f88aa6d8b09 req-6d7597eb-228b-418f-9fe1-fbbc5949a41f service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-db80d365-9096-4b63-a5e1-7f88aa6d8b09 req-6d7597eb-228b-418f-9fe1-fbbc5949a41f service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] No waiting events found dispatching network-vif-unplugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-db80d365-9096-4b63-a5e1-7f88aa6d8b09 req-6d7597eb-228b-418f-9fe1-fbbc5949a41f service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-vif-unplugged-c1696001-71da-4a44-b142-02f5e0248e99 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:45:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Instance destroyed successfully.
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lazy-loading 'resources' on Instance uuid 5bce81d0-809c-4c80-8740-c0277d7a290d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1313417894',display_name='tempest-TestVolumeSwap-server-1313417894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1313417894',id=17,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6Unm1D1ckU3FNB7leJUmhJKSAC/Us2wY1bg4EUpy4iNWvHGbpcs/Vzd1FJxSGRQkOX2R0kX8oyXa6Zwa9Nx1QZgwfpfqJSClFFlUeSKLeGnfiYu7DW9VWarC+1fsiBPg==',key_name='tempest-keypair-631041237',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1081931234049bfa339c53bc493c3d0',ramdisk_id='',reservation_id='r-esd1ywzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-565048462',owner_user_name='tempest-TestVolumeSwap-565048462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d980521518bc4984891b95b73a1a4b4f',uuid=5bce81d0-809c-4c80-8740-c0277d7a290d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Converting VIF {"id": "c1696001-71da-4a44-b142-02f5e0248e99", "address": "fa:16:3e:11:29:ea", "network": {"id": "23f5c1d4-ddd5-46f1-85e6-7338660d69fe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1937959080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1081931234049bfa339c53bc493c3d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1696001-71", "ovs_interfaceid": "c1696001-71da-4a44-b142-02f5e0248e99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:29:ea,bridge_name='br-int',has_traffic_filtering=True,id=c1696001-71da-4a44-b142-02f5e0248e99,network=Network(23f5c1d4-ddd5-46f1-85e6-7338660d69fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1696001-71') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG os_vif [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:29:ea,bridge_name='br-int',has_traffic_filtering=True,id=c1696001-71da-4a44-b142-02f5e0248e99,network=Network(23f5c1d4-ddd5-46f1-85e6-7338660d69fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1696001-71') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1696001-71, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35375c00-0bd8-4ee8-9ea5-0eb5c8acfa92) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:39 user nova-compute[75288]: INFO os_vif [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:29:ea,bridge_name='br-int',has_traffic_filtering=True,id=c1696001-71da-4a44-b142-02f5e0248e99,network=Network(23f5c1d4-ddd5-46f1-85e6-7338660d69fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1696001-71')
Nov 10 22:45:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Deleting instance files /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d_del
Nov 10 22:45:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Deletion of /opt/stack/data/nova/instances/5bce81d0-809c-4c80-8740-c0277d7a290d_del complete
Nov 10 22:45:39 user nova-compute[75288]: INFO nova.compute.manager [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 22:45:39 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:45:39 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:40 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Took 1.17 seconds to deallocate network for instance.
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-5cbc2a09-8d2e-4747-bab6-8327921b863d req-4e23bf5e-e751-494c-9fcf-26cc83e87fb8 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-deleted-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:40 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Took 0.90 seconds to deallocate network for instance.
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 0 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.219s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffd1bb2b-8c15-4dbe-a185-a1f45c210fef req-352b88b0-35a9-4de6-86da-7432eb1b3a72 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffd1bb2b-8c15-4dbe-a185-a1f45c210fef req-352b88b0-35a9-4de6-86da-7432eb1b3a72 service nova] Acquiring lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffd1bb2b-8c15-4dbe-a185-a1f45c210fef req-352b88b0-35a9-4de6-86da-7432eb1b3a72 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffd1bb2b-8c15-4dbe-a185-a1f45c210fef req-352b88b0-35a9-4de6-86da-7432eb1b3a72 service nova] Lock "33ebbf72-0319-4e06-af0c-cf1462053666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffd1bb2b-8c15-4dbe-a185-a1f45c210fef req-352b88b0-35a9-4de6-86da-7432eb1b3a72 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] No waiting events found dispatching network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:40 user nova-compute[75288]: WARNING nova.compute.manager [req-ffd1bb2b-8c15-4dbe-a185-a1f45c210fef req-352b88b0-35a9-4de6-86da-7432eb1b3a72 service nova] [instance: 33ebbf72-0319-4e06-af0c-cf1462053666] Received unexpected event network-vif-plugged-a17af079-be58-40cc-a993-4d5304f20445 for instance with vm_state deleted and task_state None.
Nov 10 22:45:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffd1bb2b-8c15-4dbe-a185-a1f45c210fef req-352b88b0-35a9-4de6-86da-7432eb1b3a72 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-vif-deleted-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:40 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Deleted allocations for instance 33ebbf72-0319-4e06-af0c-cf1462053666
Nov 10 22:45:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce494a6f-3307-43d0-b31d-f9cf1f8440a3 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "33ebbf72-0319-4e06-af0c-cf1462053666" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.773s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:45:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:45:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-2ecbf4e0-38df-4073-bbae-f6c6317d8859 req-2093740e-d8ca-4931-910a-503eca80fb92 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received event network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2ecbf4e0-38df-4073-bbae-f6c6317d8859 req-2093740e-d8ca-4931-910a-503eca80fb92 service nova] Acquiring lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2ecbf4e0-38df-4073-bbae-f6c6317d8859 req-2093740e-d8ca-4931-910a-503eca80fb92 service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2ecbf4e0-38df-4073-bbae-f6c6317d8859 req-2093740e-d8ca-4931-910a-503eca80fb92 service nova] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-2ecbf4e0-38df-4073-bbae-f6c6317d8859 req-2093740e-d8ca-4931-910a-503eca80fb92 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] No waiting events found dispatching network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:45:41 user nova-compute[75288]: WARNING nova.compute.manager [req-2ecbf4e0-38df-4073-bbae-f6c6317d8859 req-2093740e-d8ca-4931-910a-503eca80fb92 service nova] [instance: 5bce81d0-809c-4c80-8740-c0277d7a290d] Received unexpected event network-vif-plugged-c1696001-71da-4a44-b142-02f5e0248e99 for instance with vm_state deleted and task_state None.
Nov 10 22:45:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:41 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Deleted allocations for instance 5bce81d0-809c-4c80-8740-c0277d7a290d
Nov 10 22:45:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bea-2a43-49aa-89f7-2548f603b109 tempest-TestVolumeSwap-565048462 tempest-TestVolumeSwap-565048462-project-member] Lock "5bce81d0-809c-4c80-8740-c0277d7a290d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.680s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:52 user nova-compute[75288]: INFO nova.compute.manager [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Unshelving
Nov 10 22:45:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'pci_requests' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'numa_topology' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:45:52 user nova-compute[75288]: INFO nova.compute.claims [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Claim successful on node user
Nov 10 22:45:52 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:45:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:52 user nova-compute[75288]: INFO nova.network.neutron [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating port 004daad5-a7a8-4929-8faf-aa904b1c2bb4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquired lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing instance network info cache due to event network-changed-004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] Acquiring lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Releasing lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:45:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Creating image(s)
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] Acquired lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Refreshing network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG nova.objects.base [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<42be4921-aac5-4ee5-9564-455e9558ded0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "607123c9e55cc09e0b80dd3aa9bcb2d9b7048043" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "607123c9e55cc09e0b80dd3aa9bcb2d9b7048043" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.part --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG nova.virt.images [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] 8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.part /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updated VIF entry in instance network info cache for port 004daad5-a7a8-4929-8faf-aa904b1c2bb4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9309abf-2c36-4b0c-b6d7-6d98e3dbcd8a req-2a49c15e-b8af-4cc1-880c-79b1448b2309 service nova] Releasing lock "refresh_cache-42be4921-aac5-4ee5-9564-455e9558ded0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.part /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.converted" returned: 0 in 0.293s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "607123c9e55cc09e0b80dd3aa9bcb2d9b7048043" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.806s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043 --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "607123c9e55cc09e0b80dd3aa9bcb2d9b7048043" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "607123c9e55cc09e0b80dd3aa9bcb2d9b7048043" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043 --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043,backing_fmt=raw /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043,backing_fmt=raw /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk 1073741824" returned: 0 in 0.051s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "607123c9e55cc09e0b80dd3aa9bcb2d9b7048043" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043 --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'migration_context' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG nova.objects.base [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<42be4921-aac5-4ee5-9564-455e9558ded0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:45:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Rebasing disk image.
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec -F raw /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-changed-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Refreshing instance network info cache due to event network-changed-e7bac544-b5fc-4020-af9f-183a0208faa1. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] Acquiring lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] Acquired lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Refreshing network info cache for port e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updated VIF entry in instance network info cache for port e7bac544-b5fc-4020-af9f-183a0208faa1. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating instance_info_cache with network_info: [{"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37b6ba62-0790-4eb4-9ded-bdfd6db0b8e9 req-a7aed735-bc4c-435c-8046-53ff2662a2da service nova] Releasing lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec -F raw /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk" returned: 0 in 2.417s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Ensure instance console log exists: /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Start _get_guest_xml network_info=[{"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3f4534fb3c8d04cccf548b62b4fab116',container_format='bare',created_at=2023-11-10T22:43:59Z,direct_url=<?>,disk_format='qcow2',id=8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-348158825-shelved',owner='53f6c30d0f1a467f8e977a73463e2d1e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T22:44:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:45:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3f4534fb3c8d04cccf548b62b4fab116',container_format='bare',created_at=2023-11-10T22:43:59Z,direct_url=<?>,disk_format='qcow2',id=8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-348158825-shelved',owner='53f6c30d0f1a467f8e977a73463e2d1e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T22:44:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<42be4921-aac5-4ee5-9564-455e9558ded0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-348158825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-348158825',id=19,image_ref='8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-276005353',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-lihpwz8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member',shelved_at='2023-11-10T22:44:05.429333',shelved_host='user',shelved_image_id='8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=42be4921-aac5-4ee5-9564-455e9558ded0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:45:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'pci_devices' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.objects.base [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Object Instance<42be4921-aac5-4ee5-9564-455e9558ded0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:45:59 user nova-compute[75288]:   <uuid>42be4921-aac5-4ee5-9564-455e9558ded0</uuid>
Nov 10 22:45:59 user nova-compute[75288]:   <name>instance-00000013</name>
Nov 10 22:45:59 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:45:59 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:45:59 user nova-compute[75288]:   <metadata>
Nov 10 22:45:59 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:45:59 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:45:59 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-348158825</nova:name>
Nov 10 22:45:59 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:45:58</nova:creationTime>
Nov 10 22:45:59 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:45:59 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:45:59 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:45:59 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:45:59 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:45:59 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:45:59 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:45:59 user nova-compute[75288]:       <nova:owner>
Nov 10 22:45:59 user nova-compute[75288]:         <nova:user uuid="05f170ae42004d57abea1bf318d05dab">tempest-AttachVolumeShelveTestJSON-1618351090-project-member</nova:user>
Nov 10 22:45:59 user nova-compute[75288]:         <nova:project uuid="53f6c30d0f1a467f8e977a73463e2d1e">tempest-AttachVolumeShelveTestJSON-1618351090</nova:project>
Nov 10 22:45:59 user nova-compute[75288]:       </nova:owner>
Nov 10 22:45:59 user nova-compute[75288]:       <nova:root type="image" uuid="8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71"/>
Nov 10 22:45:59 user nova-compute[75288]:       <nova:ports>
Nov 10 22:45:59 user nova-compute[75288]:         <nova:port uuid="004daad5-a7a8-4929-8faf-aa904b1c2bb4">
Nov 10 22:45:59 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 22:45:59 user nova-compute[75288]:         </nova:port>
Nov 10 22:45:59 user nova-compute[75288]:       </nova:ports>
Nov 10 22:45:59 user nova-compute[75288]:     </nova:instance>
Nov 10 22:45:59 user nova-compute[75288]:   </metadata>
Nov 10 22:45:59 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:45:59 user nova-compute[75288]:     <system>
Nov 10 22:45:59 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:45:59 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:45:59 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:45:59 user nova-compute[75288]:       <entry name="serial">42be4921-aac5-4ee5-9564-455e9558ded0</entry>
Nov 10 22:45:59 user nova-compute[75288]:       <entry name="uuid">42be4921-aac5-4ee5-9564-455e9558ded0</entry>
Nov 10 22:45:59 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:45:59 user nova-compute[75288]:     </system>
Nov 10 22:45:59 user nova-compute[75288]:   </sysinfo>
Nov 10 22:45:59 user nova-compute[75288]:   <os>
Nov 10 22:45:59 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:45:59 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:45:59 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:45:59 user nova-compute[75288]:   </os>
Nov 10 22:45:59 user nova-compute[75288]:   <features>
Nov 10 22:45:59 user nova-compute[75288]:     <acpi/>
Nov 10 22:45:59 user nova-compute[75288]:     <apic/>
Nov 10 22:45:59 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:45:59 user nova-compute[75288]:   </features>
Nov 10 22:45:59 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:45:59 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:45:59 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:45:59 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:45:59 user nova-compute[75288]:   </clock>
Nov 10 22:45:59 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:45:59 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:45:59 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:45:59 user nova-compute[75288]:   </cpu>
Nov 10 22:45:59 user nova-compute[75288]:   <devices>
Nov 10 22:45:59 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:45:59 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:45:59 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk"/>
Nov 10 22:45:59 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:45:59 user nova-compute[75288]:     </disk>
Nov 10 22:45:59 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:45:59 user nova-compute[75288]:       <mac address="fa:16:3e:0b:1a:e4"/>
Nov 10 22:45:59 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:45:59 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:45:59 user nova-compute[75288]:       <target dev="tap004daad5-a7"/>
Nov 10 22:45:59 user nova-compute[75288]:     </interface>
Nov 10 22:45:59 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:45:59 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/console.log" append="off"/>
Nov 10 22:45:59 user nova-compute[75288]:     </serial>
Nov 10 22:45:59 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:45:59 user nova-compute[75288]:     <video>
Nov 10 22:45:59 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:45:59 user nova-compute[75288]:     </video>
Nov 10 22:45:59 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:45:59 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:45:59 user nova-compute[75288]:     </rng>
Nov 10 22:45:59 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:45:59 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:45:59 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:45:59 user nova-compute[75288]:     </memballoon>
Nov 10 22:45:59 user nova-compute[75288]:   </devices>
Nov 10 22:45:59 user nova-compute[75288]: </domain>
Nov 10 22:45:59 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-348158825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-348158825',id=19,image_ref='8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-276005353',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-lihpwz8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member',shelved_at='2023-11-10T22:44:05.429333',shelved_host='user',shelved_image_id='8805bbea-4fa2-4a9b-9f0e-9de79dd0fa71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=42be4921-aac5-4ee5-9564-455e9558ded0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG os_vif [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86e0e40f-b6f0-5da8-a608-8f40dd9e01c7', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap004daad5-a7, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap004daad5-a7, col_values=(('qos', UUID('264ddf05-99cc-4900-b17e-7da204ae4241')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap004daad5-a7, col_values=(('external_ids', {'iface-id': '004daad5-a7a8-4929-8faf-aa904b1c2bb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:1a:e4', 'vm-uuid': '42be4921-aac5-4ee5-9564-455e9558ded0'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:45:59 user nova-compute[75288]: INFO os_vif [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7')
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] No VIF found with MAC fa:16:3e:0b:1a:e4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8b446b0-24d7-4266-93c5-d7eb0891859f req-94fe4f00-b82c-4cb8-a384-7cada2cb9167 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8b446b0-24d7-4266-93c5-d7eb0891859f req-94fe4f00-b82c-4cb8-a384-7cada2cb9167 service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8b446b0-24d7-4266-93c5-d7eb0891859f req-94fe4f00-b82c-4cb8-a384-7cada2cb9167 service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8b446b0-24d7-4266-93c5-d7eb0891859f req-94fe4f00-b82c-4cb8-a384-7cada2cb9167 service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8b446b0-24d7-4266-93c5-d7eb0891859f req-94fe4f00-b82c-4cb8-a384-7cada2cb9167 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:00 user nova-compute[75288]: WARNING nova.compute.manager [req-f8b446b0-24d7-4266-93c5-d7eb0891859f req-94fe4f00-b82c-4cb8-a384-7cada2cb9167 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received unexpected event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 22:46:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-f0704b43-61ad-437a-af68-1b4ca61bd826 req-5cb441ad-e06c-4df0-94f1-65b701dc1ddf service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f0704b43-61ad-437a-af68-1b4ca61bd826 req-5cb441ad-e06c-4df0-94f1-65b701dc1ddf service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f0704b43-61ad-437a-af68-1b4ca61bd826 req-5cb441ad-e06c-4df0-94f1-65b701dc1ddf service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f0704b43-61ad-437a-af68-1b4ca61bd826 req-5cb441ad-e06c-4df0-94f1-65b701dc1ddf service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-f0704b43-61ad-437a-af68-1b4ca61bd826 req-5cb441ad-e06c-4df0-94f1-65b701dc1ddf service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:03 user nova-compute[75288]: WARNING nova.compute.manager [req-f0704b43-61ad-437a-af68-1b4ca61bd826 req-5cb441ad-e06c-4df0-94f1-65b701dc1ddf service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received unexpected event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 22:46:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:46:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance spawned successfully.
Nov 10 22:46:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d7b07ba9-d451-431a-97bc-727c73b7fd70 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.626s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG nova.objects.instance [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:05 user nova-compute[75288]: INFO nova.compute.manager [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attaching volume 63f3c4f4-e73d-4a9a-ada5-39212124e248 to /dev/vdb
Nov 10 22:46:05 user nova-compute[75288]: DEBUG os_brick.utils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0688d461-dd88-4381-9734-63425e22a4a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc89d607-af58-42b2-98ca-12a8bd28bcb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[855e3dc7-a564-430e-aa1f-4e008281c32a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[297cda2d-9869-4cfd-8fb8-2b7c4bb84754]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:46:06 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:46:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f08ec-0f4a-4e71-b161-7fe9f5f1c68f]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG os_brick.utils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:46:06 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating existing volume attachment record: be9e7ae8-8e74-430e-9530-7843f9f38763 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:07 user nova-compute[75288]: INFO nova.compute.manager [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Terminating instance
Nov 10 22:46:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-468101aa-d830-4618-bd52-b3feb65aa847 req-6212cfb1-63ec-423b-954b-97f13fe4c868 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received event network-vif-unplugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-468101aa-d830-4618-bd52-b3feb65aa847 req-6212cfb1-63ec-423b-954b-97f13fe4c868 service nova] Acquiring lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-468101aa-d830-4618-bd52-b3feb65aa847 req-6212cfb1-63ec-423b-954b-97f13fe4c868 service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-468101aa-d830-4618-bd52-b3feb65aa847 req-6212cfb1-63ec-423b-954b-97f13fe4c868 service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-468101aa-d830-4618-bd52-b3feb65aa847 req-6212cfb1-63ec-423b-954b-97f13fe4c868 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] No waiting events found dispatching network-vif-unplugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-468101aa-d830-4618-bd52-b3feb65aa847 req-6212cfb1-63ec-423b-954b-97f13fe4c868 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received event network-vif-unplugged-3465895e-ea81-446f-8a4b-75cc18c2527e for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Instance destroyed successfully.
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lazy-loading 'resources' on Instance uuid dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-851556792',display_name='tempest-VolumesActionsTest-instance-851556792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-851556792',id=22,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1565a98e78e0494fbe3781e8aba7f68b',ramdisk_id='',reservation_id='r-ju62ve4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2053090080',owner_user_name='tempest-VolumesActionsTest-2053090080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:44:06Z,user_data=None,user_id='0190cc3da523436fa6cb18cbe36224cf',uuid=dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Converting VIF {"id": "3465895e-ea81-446f-8a4b-75cc18c2527e", "address": "fa:16:3e:a1:19:a2", "network": {"id": "e54cc5c4-8cb8-4b57-991c-8fe6608b234f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1349957769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1565a98e78e0494fbe3781e8aba7f68b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3465895e-ea", "ovs_interfaceid": "3465895e-ea81-446f-8a4b-75cc18c2527e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:19:a2,bridge_name='br-int',has_traffic_filtering=True,id=3465895e-ea81-446f-8a4b-75cc18c2527e,network=Network(e54cc5c4-8cb8-4b57-991c-8fe6608b234f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3465895e-ea') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG os_vif [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:19:a2,bridge_name='br-int',has_traffic_filtering=True,id=3465895e-ea81-446f-8a4b-75cc18c2527e,network=Network(e54cc5c4-8cb8-4b57-991c-8fe6608b234f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3465895e-ea') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3465895e-ea, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cbce395-e9d4-4f8b-9a61-826f591aee00) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:46:08 user nova-compute[75288]: INFO os_vif [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:19:a2,bridge_name='br-int',has_traffic_filtering=True,id=3465895e-ea81-446f-8a4b-75cc18c2527e,network=Network(e54cc5c4-8cb8-4b57-991c-8fe6608b234f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3465895e-ea')
Nov 10 22:46:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Deleting instance files /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6_del
Nov 10 22:46:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Deletion of /opt/stack/data/nova/instances/dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6_del complete
Nov 10 22:46:08 user nova-compute[75288]: INFO nova.compute.manager [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 10 22:46:08 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:08 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Took 0.71 seconds to deallocate network for instance.
Nov 10 22:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-1decc252-ab7c-4097-baaf-ca77a837f28c req-00758e4a-4250-4516-8b3b-038a6b54edce service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received event network-vif-deleted-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:09 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Deleted allocations for instance dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6
Nov 10 22:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3e177094-576b-47e5-a01d-842f946eb7ea tempest-VolumesActionsTest-2053090080 tempest-VolumesActionsTest-2053090080-project-member] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.478s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-0afdba33-b10d-41fb-b93a-18e16fdc68d3 req-a9e6218b-a147-4fce-9695-db41bd0821c2 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received event network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0afdba33-b10d-41fb-b93a-18e16fdc68d3 req-a9e6218b-a147-4fce-9695-db41bd0821c2 service nova] Acquiring lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0afdba33-b10d-41fb-b93a-18e16fdc68d3 req-a9e6218b-a147-4fce-9695-db41bd0821c2 service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0afdba33-b10d-41fb-b93a-18e16fdc68d3 req-a9e6218b-a147-4fce-9695-db41bd0821c2 service nova] Lock "dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-0afdba33-b10d-41fb-b93a-18e16fdc68d3 req-a9e6218b-a147-4fce-9695-db41bd0821c2 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] No waiting events found dispatching network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:09 user nova-compute[75288]: WARNING nova.compute.manager [req-0afdba33-b10d-41fb-b93a-18e16fdc68d3 req-a9e6218b-a147-4fce-9695-db41bd0821c2 service nova] [instance: dbd25e9b-79ed-4ed3-9891-8a4a2f2d37a6] Received unexpected event network-vif-plugged-3465895e-ea81-446f-8a4b-75cc18c2527e for instance with vm_state deleted and task_state None.
Nov 10 22:46:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:46:15 user nova-compute[75288]: INFO nova.compute.claims [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Claim successful on node user
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:46:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.policy [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1839c7b8368947ccacf91af8fd6f0faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd01027aba7e1424390b507afbad93f23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:46:15 user nova-compute[75288]: INFO nova.virt.block_device [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Booting with volume 6a82a0b8-c74b-4bf1-909a-6350439bb7ef at /dev/vda
Nov 10 22:46:15 user nova-compute[75288]: DEBUG os_brick.utils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c363813d-6e56-4032-a011-abdc4694980d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4bedc-56c6-4f82-9a77-9fa61a3b1010]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a539a7-1bc7-44ac-b879-cb893cc82f01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93b180e-2c95-4548-af3d-72129de4febb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:46:15 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:46:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[47746bb7-435b-462f-b3b1-5fc2ae118eea]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG os_brick.utils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:46:15 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating existing volume attachment record: e4ffe870-c6c2-4e3b-bf93-a0a302b386f7 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:46:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Successfully created port: 16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Successfully updated port: 16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquired lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-changed-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Refreshing instance network info cache due to event network-changed-16999ac2-b068-479b-a705-8342b29addc7. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] Acquiring lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating instance_info_cache with network_info: [{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Releasing lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance network_info: |[{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] Acquired lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Refreshing network info cache for port 16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updated VIF entry in instance network info cache for port 16999ac2-b068-479b-a705-8342b29addc7. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating instance_info_cache with network_info: [{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67647c47-2bd0-476c-aaa2-7e09ba57fac1 req-bb982838-6fa0-4c01-a6d4-c66cf97cd643 service nova] Releasing lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Skipping network cache update for instance because it is Building. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:46:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 032de95e-98a7-411d-8726-5bf3a5c0ca49 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updating instance_info_cache with network_info: [{"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-032de95e-98a7-411d-8726-5bf3a5c0ca49" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:46:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:46:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:46:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7126MB free_disk=24.982254028320312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Applying migration context for instance b9342997-048d-4f4f-a552-de76f2a0a444 as it has an incoming, in-progress migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d. Migration status is finished {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 22:46:28 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating resource usage from migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 054f3333-ecb7-4705-9b83-1f42e6cb90fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 42be4921-aac5-4ee5-9564-455e9558ded0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:46:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:46:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:46:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:46:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:46:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSbuCGPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:46:32 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:46:32 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:46:32 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164baec-1069-4c22-b54a-a92d9ba142d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:46:32 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd42da8-1656-4b01-a990-484d817ba326]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248] added
Nov 10 22:46:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a1189-04a6-45a2-90b1-25a68e4a2ab8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc607d-6b13-406f-bef6-c399d5519ea8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSbuCGPE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSbuCGPE" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[128ffe3d-219f-4170-9f33-a92933ab0478]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tSbuCGPE'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8f5bd1-223e-4f01-9ea8-57af90c0845b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a914779-226c-479b-af9e-abbf8bf75e83]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:32 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:32 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f7c0b2-082b-418b-95f2-5d5e63aaff6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260]
Nov 10 22:46:32 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260] successful.
Nov 10 22:46:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c04251-41ce-4bfd-a6e6-ef79c53a2bc6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[10598138-f134-430d-ae8d-adca3f3e246a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:32 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:32 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:32 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:32 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73d3ef4-1bb6-469a-9ab3-1d2b65ce6320]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSbuCGPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:46:33 user nova-compute[75288]: INFO nova.compute.claims [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Claim successful on node user
Nov 10 22:46:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:46:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26166646563646639', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166646563646639', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.objects.instance [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:46:33 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:46:33 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:46:33 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:46:33 user nova-compute[75288]:   <serial>63f3c4f4-e73d-4a9a-ada5-39212124e248</serial>
Nov 10 22:46:33 user nova-compute[75288]: </disk>
Nov 10 22:46:33 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.policy [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f6b930fa714405192e875eaf51cff95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28bbf495a59c4f24945da89346c71dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:46:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Creating image(s)
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "/opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "/opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No VIF found with MAC fa:16:3e:81:41:97, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk 1073741824" returned: 0 in 0.058s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36849660-df5b-45b1-aa22-b61657788a0a tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.756s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Successfully created port: 712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Cannot resize image /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Ensure instance console log exists: /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Successfully updated port: 712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquired lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-changed-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Refreshing instance network info cache due to event network-changed-712a83c2-bcc4-4e16-974c-9b40d6b237aa. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] Acquiring lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updating instance_info_cache with network_info: [{"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Releasing lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Instance network_info: |[{"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] Acquired lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Refreshing network info cache for port 712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Start _get_guest_xml network_info=[{"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:46:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:46:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-295127794',display_name='tempest-AttachVolumeTestJSON-server-295127794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-295127794',id=27,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWrr6N4qRqSnzmK9Sqh2sozZXJn8Z1v1BY0Xmn1LHauWJMt//FfrYX2vs7J0WyltRqydGBOV0iWT7ziffx4kj+PIFC8Y8FKdrTsl70wtxqJkbQ8cwTT/brMIsAo+ecd1w==',key_name='tempest-keypair-1291823449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-4sx4qp62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=f6b48e8c-3cc2-4121-84fe-ae84fcae327d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=712a83c2-bcc4-4e16-974c-9b40d6b237aa,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712a83c2-bc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:46:35 user nova-compute[75288]:   <uuid>f6b48e8c-3cc2-4121-84fe-ae84fcae327d</uuid>
Nov 10 22:46:35 user nova-compute[75288]:   <name>instance-0000001b</name>
Nov 10 22:46:35 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:46:35 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:46:35 user nova-compute[75288]:   <metadata>
Nov 10 22:46:35 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:46:35 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:46:35 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-295127794</nova:name>
Nov 10 22:46:35 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:46:35</nova:creationTime>
Nov 10 22:46:35 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:46:35 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:46:35 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:46:35 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:46:35 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:46:35 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:46:35 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:46:35 user nova-compute[75288]:       <nova:owner>
Nov 10 22:46:35 user nova-compute[75288]:         <nova:user uuid="7f6b930fa714405192e875eaf51cff95">tempest-AttachVolumeTestJSON-979908124-project-member</nova:user>
Nov 10 22:46:35 user nova-compute[75288]:         <nova:project uuid="28bbf495a59c4f24945da89346c71dff">tempest-AttachVolumeTestJSON-979908124</nova:project>
Nov 10 22:46:35 user nova-compute[75288]:       </nova:owner>
Nov 10 22:46:35 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:46:35 user nova-compute[75288]:       <nova:ports>
Nov 10 22:46:35 user nova-compute[75288]:         <nova:port uuid="712a83c2-bcc4-4e16-974c-9b40d6b237aa">
Nov 10 22:46:35 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 22:46:35 user nova-compute[75288]:         </nova:port>
Nov 10 22:46:35 user nova-compute[75288]:       </nova:ports>
Nov 10 22:46:35 user nova-compute[75288]:     </nova:instance>
Nov 10 22:46:35 user nova-compute[75288]:   </metadata>
Nov 10 22:46:35 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:46:35 user nova-compute[75288]:     <system>
Nov 10 22:46:35 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:46:35 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:46:35 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:46:35 user nova-compute[75288]:       <entry name="serial">f6b48e8c-3cc2-4121-84fe-ae84fcae327d</entry>
Nov 10 22:46:35 user nova-compute[75288]:       <entry name="uuid">f6b48e8c-3cc2-4121-84fe-ae84fcae327d</entry>
Nov 10 22:46:35 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:46:35 user nova-compute[75288]:     </system>
Nov 10 22:46:35 user nova-compute[75288]:   </sysinfo>
Nov 10 22:46:35 user nova-compute[75288]:   <os>
Nov 10 22:46:35 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:46:35 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:46:35 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:46:35 user nova-compute[75288]:   </os>
Nov 10 22:46:35 user nova-compute[75288]:   <features>
Nov 10 22:46:35 user nova-compute[75288]:     <acpi/>
Nov 10 22:46:35 user nova-compute[75288]:     <apic/>
Nov 10 22:46:35 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:46:35 user nova-compute[75288]:   </features>
Nov 10 22:46:35 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:46:35 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:46:35 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:46:35 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:46:35 user nova-compute[75288]:   </clock>
Nov 10 22:46:35 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:46:35 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:46:35 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:46:35 user nova-compute[75288]:   </cpu>
Nov 10 22:46:35 user nova-compute[75288]:   <devices>
Nov 10 22:46:35 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:46:35 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:46:35 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk"/>
Nov 10 22:46:35 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:46:35 user nova-compute[75288]:     </disk>
Nov 10 22:46:35 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:46:35 user nova-compute[75288]:       <mac address="fa:16:3e:06:c2:db"/>
Nov 10 22:46:35 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:46:35 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:46:35 user nova-compute[75288]:       <target dev="tap712a83c2-bc"/>
Nov 10 22:46:35 user nova-compute[75288]:     </interface>
Nov 10 22:46:35 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:46:35 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/console.log" append="off"/>
Nov 10 22:46:35 user nova-compute[75288]:     </serial>
Nov 10 22:46:35 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:46:35 user nova-compute[75288]:     <video>
Nov 10 22:46:35 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:46:35 user nova-compute[75288]:     </video>
Nov 10 22:46:35 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:46:35 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:46:35 user nova-compute[75288]:     </rng>
Nov 10 22:46:35 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:46:35 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:46:35 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:46:35 user nova-compute[75288]:     </memballoon>
Nov 10 22:46:35 user nova-compute[75288]:   </devices>
Nov 10 22:46:35 user nova-compute[75288]: </domain>
Nov 10 22:46:35 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-295127794',display_name='tempest-AttachVolumeTestJSON-server-295127794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-295127794',id=27,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWrr6N4qRqSnzmK9Sqh2sozZXJn8Z1v1BY0Xmn1LHauWJMt//FfrYX2vs7J0WyltRqydGBOV0iWT7ziffx4kj+PIFC8Y8FKdrTsl70wtxqJkbQ8cwTT/brMIsAo+ecd1w==',key_name='tempest-keypair-1291823449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-4sx4qp62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=f6b48e8c-3cc2-4121-84fe-ae84fcae327d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=712a83c2-bcc4-4e16-974c-9b40d6b237aa,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712a83c2-bc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG os_vif [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=712a83c2-bcc4-4e16-974c-9b40d6b237aa,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712a83c2-bc') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d4de3cd-aa93-5332-a244-8801af5054c3', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap712a83c2-bc, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap712a83c2-bc, col_values=(('qos', UUID('495eb3ce-0228-4758-9f5e-a222efa7a318')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap712a83c2-bc, col_values=(('external_ids', {'iface-id': '712a83c2-bcc4-4e16-974c-9b40d6b237aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:c2:db', 'vm-uuid': 'f6b48e8c-3cc2-4121-84fe-ae84fcae327d'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:35 user nova-compute[75288]: INFO os_vif [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=712a83c2-bcc4-4e16-974c-9b40d6b237aa,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712a83c2-bc')
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:46:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No VIF found with MAC fa:16:3e:06:c2:db, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:46:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updated VIF entry in instance network info cache for port 712a83c2-bcc4-4e16-974c-9b40d6b237aa. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:46:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updating instance_info_cache with network_info: [{"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb81a101-7a0a-479f-a4b7-0fa1941f736e req-967a82dd-a6a3-47c4-8534-b664907eb218 service nova] Releasing lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-c37836e1-cb31-4787-8bb2-debaac24521b req-94f3449a-a94b-4655-a776-0168fef7496b service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c37836e1-cb31-4787-8bb2-debaac24521b req-94f3449a-a94b-4655-a776-0168fef7496b service nova] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c37836e1-cb31-4787-8bb2-debaac24521b req-94f3449a-a94b-4655-a776-0168fef7496b service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c37836e1-cb31-4787-8bb2-debaac24521b req-94f3449a-a94b-4655-a776-0168fef7496b service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-c37836e1-cb31-4787-8bb2-debaac24521b req-94f3449a-a94b-4655-a776-0168fef7496b service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] No waiting events found dispatching network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:37 user nova-compute[75288]: WARNING nova.compute.manager [req-c37836e1-cb31-4787-8bb2-debaac24521b req-94f3449a-a94b-4655-a776-0168fef7496b service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received unexpected event network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa for instance with vm_state building and task_state spawning.
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-eb7392ff-eb1f-4ae3-b98c-93beb826c6d1 req-80684249-448d-4040-bbfe-7e37210aea73 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eb7392ff-eb1f-4ae3-b98c-93beb826c6d1 req-80684249-448d-4040-bbfe-7e37210aea73 service nova] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eb7392ff-eb1f-4ae3-b98c-93beb826c6d1 req-80684249-448d-4040-bbfe-7e37210aea73 service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eb7392ff-eb1f-4ae3-b98c-93beb826c6d1 req-80684249-448d-4040-bbfe-7e37210aea73 service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-eb7392ff-eb1f-4ae3-b98c-93beb826c6d1 req-80684249-448d-4040-bbfe-7e37210aea73 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] No waiting events found dispatching network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:39 user nova-compute[75288]: WARNING nova.compute.manager [req-eb7392ff-eb1f-4ae3-b98c-93beb826c6d1 req-80684249-448d-4040-bbfe-7e37210aea73 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received unexpected event network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa for instance with vm_state building and task_state spawning.
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:46:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Instance spawned successfully.
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:39 user nova-compute[75288]: INFO nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 10 22:46:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:46:39 user nova-compute[75288]: INFO nova.compute.manager [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Took 6.92 seconds to build instance.
Nov 10 22:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d59c8169-f818-4b37-a046-f6dc27f89640 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.067s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:42 user nova-compute[75288]: INFO nova.compute.manager [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Unrescuing
Nov 10 22:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquired lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updating instance_info_cache with network_info: [{"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Releasing lock "refresh_cache-7b99fd44-d683-43c8-9de4-1cc73e15cc9f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'flavor' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:46:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Creating image(s)
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Ensure instance console log exists: /opt/stack/data/nova/instances/b1a7d533-cad6-4360-b6c4-f12c6fc473a8/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Start _get_guest_xml network_info=[{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1a7d533-cad6-4360-b6c4-f12c6fc473a8', 'attached_at': '', 'detached_at': '', 'volume_id': '6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'serial': '6a82a0b8-c74b-4bf1-909a-6350439bb7ef'}, 'mount_device': '/dev/vda', 'attachment_id': 'e4ffe870-c6c2-4e3b-bf93-a0a302b386f7', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:46:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:46:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:46:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:46:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:46:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:46:43 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8147710a-6cb1-4bfe-836b-165b06ca726d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:46:43 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[041192c9-9d7a-412a-806d-bccd21a2b9c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef] added
Nov 10 22:46:43 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df8f5eb-3fe2-4a6d-a6c4-86a48df5567a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a9d28-4bc2-4b5c-91e4-454a60d201c8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDOdRbeI {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDOdRbeI" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983a505-42a8-404e-ae32-f6ef732dfd0f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDOdRbeI'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff75fa5-7477-4361-a68d-8a07c1451f24]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd8d609-7028-4da4-9cef-b5918f840000]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3649c72c-e425-4d24-b8ef-bab793096358]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]
Nov 10 22:46:44 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.
Nov 10 22:46:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.063s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[26871e09-4930-43c9-bf78-0eb2237756bc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f774ffb-cd82-44da-9f74-984e40e0fa6b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:46:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:44 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:46:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d496e04-3d90-4c32-aa9c-47ada98be404]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-70807a7e-eab8-4e6f-a75f-24b19f58cbe3 req-6f0d3baf-81f8-40a7-af19-1bc44acdae42 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-70807a7e-eab8-4e6f-a75f-24b19f58cbe3 req-6f0d3baf-81f8-40a7-af19-1bc44acdae42 service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-70807a7e-eab8-4e6f-a75f-24b19f58cbe3 req-6f0d3baf-81f8-40a7-af19-1bc44acdae42 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-70807a7e-eab8-4e6f-a75f-24b19f58cbe3 req-6f0d3baf-81f8-40a7-af19-1bc44acdae42 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-70807a7e-eab8-4e6f-a75f-24b19f58cbe3 req-6f0d3baf-81f8-40a7-af19-1bc44acdae42 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:44 user nova-compute[75288]: WARNING nova.compute.manager [req-70807a7e-eab8-4e6f-a75f-24b19f58cbe3 req-6f0d3baf-81f8-40a7-af19-1bc44acdae42 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:46:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance destroyed successfully.
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-changed-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Refreshing instance network info cache due to event network-changed-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] Acquiring lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] Acquired lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.network.neutron [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Refreshing network info cache for port 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23066333163363535', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066333163363535', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1858541466',display_name='tempest-ServerActionsTestOtherA-server-1858541466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1858541466',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ez96icqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=b1a7d533-cad6-4360-b6c4-f12c6fc473a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'pci_devices' on Instance uuid b1a7d533-cad6-4360-b6c4-f12c6fc473a8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:46:45 user nova-compute[75288]:   <uuid>b1a7d533-cad6-4360-b6c4-f12c6fc473a8</uuid>
Nov 10 22:46:45 user nova-compute[75288]:   <name>instance-0000001a</name>
Nov 10 22:46:45 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:46:45 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:46:45 user nova-compute[75288]:   <metadata>
Nov 10 22:46:45 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:46:45 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:46:45 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-1858541466</nova:name>
Nov 10 22:46:45 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:46:43</nova:creationTime>
Nov 10 22:46:45 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:46:45 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:46:45 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:46:45 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:46:45 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:46:45 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:46:45 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:46:45 user nova-compute[75288]:       <nova:owner>
Nov 10 22:46:45 user nova-compute[75288]:         <nova:user uuid="1839c7b8368947ccacf91af8fd6f0faf">tempest-ServerActionsTestOtherA-1568173136-project-member</nova:user>
Nov 10 22:46:45 user nova-compute[75288]:         <nova:project uuid="d01027aba7e1424390b507afbad93f23">tempest-ServerActionsTestOtherA-1568173136</nova:project>
Nov 10 22:46:45 user nova-compute[75288]:       </nova:owner>
Nov 10 22:46:45 user nova-compute[75288]:       <nova:ports>
Nov 10 22:46:45 user nova-compute[75288]:         <nova:port uuid="16999ac2-b068-479b-a705-8342b29addc7">
Nov 10 22:46:45 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 22:46:45 user nova-compute[75288]:         </nova:port>
Nov 10 22:46:45 user nova-compute[75288]:       </nova:ports>
Nov 10 22:46:45 user nova-compute[75288]:     </nova:instance>
Nov 10 22:46:45 user nova-compute[75288]:   </metadata>
Nov 10 22:46:45 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:46:45 user nova-compute[75288]:     <system>
Nov 10 22:46:45 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:46:45 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:46:45 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:46:45 user nova-compute[75288]:       <entry name="serial">b1a7d533-cad6-4360-b6c4-f12c6fc473a8</entry>
Nov 10 22:46:45 user nova-compute[75288]:       <entry name="uuid">b1a7d533-cad6-4360-b6c4-f12c6fc473a8</entry>
Nov 10 22:46:45 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:46:45 user nova-compute[75288]:     </system>
Nov 10 22:46:45 user nova-compute[75288]:   </sysinfo>
Nov 10 22:46:45 user nova-compute[75288]:   <os>
Nov 10 22:46:45 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:46:45 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:46:45 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:46:45 user nova-compute[75288]:   </os>
Nov 10 22:46:45 user nova-compute[75288]:   <features>
Nov 10 22:46:45 user nova-compute[75288]:     <acpi/>
Nov 10 22:46:45 user nova-compute[75288]:     <apic/>
Nov 10 22:46:45 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:46:45 user nova-compute[75288]:   </features>
Nov 10 22:46:45 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:46:45 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:46:45 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:46:45 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:46:45 user nova-compute[75288]:   </clock>
Nov 10 22:46:45 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:46:45 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:46:45 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:46:45 user nova-compute[75288]:   </cpu>
Nov 10 22:46:45 user nova-compute[75288]:   <devices>
Nov 10 22:46:45 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:46:45 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:46:45 user nova-compute[75288]:       <source dev="/dev/sde"/>
Nov 10 22:46:45 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:46:45 user nova-compute[75288]:       <serial>6a82a0b8-c74b-4bf1-909a-6350439bb7ef</serial>
Nov 10 22:46:45 user nova-compute[75288]:     </disk>
Nov 10 22:46:45 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:46:45 user nova-compute[75288]:       <mac address="fa:16:3e:f8:7b:57"/>
Nov 10 22:46:45 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:46:45 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:46:45 user nova-compute[75288]:       <target dev="tap16999ac2-b0"/>
Nov 10 22:46:45 user nova-compute[75288]:     </interface>
Nov 10 22:46:45 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:46:45 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b1a7d533-cad6-4360-b6c4-f12c6fc473a8/console.log" append="off"/>
Nov 10 22:46:45 user nova-compute[75288]:     </serial>
Nov 10 22:46:45 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:46:45 user nova-compute[75288]:     <video>
Nov 10 22:46:45 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:46:45 user nova-compute[75288]:     </video>
Nov 10 22:46:45 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:46:45 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:46:45 user nova-compute[75288]:     </rng>
Nov 10 22:46:45 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:46:45 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:46:45 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:46:45 user nova-compute[75288]:     </memballoon>
Nov 10 22:46:45 user nova-compute[75288]:   </devices>
Nov 10 22:46:45 user nova-compute[75288]: </domain>
Nov 10 22:46:45 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1858541466',display_name='tempest-ServerActionsTestOtherA-server-1858541466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1858541466',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ez96icqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=b1a7d533-cad6-4360-b6c4-f12c6fc473a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG os_vif [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a517a037-5229-5960-9006-f963efb41e66', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16999ac2-b0, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16999ac2-b0, col_values=(('qos', UUID('ff0dd9d5-c73f-4ea6-934f-a09b234b29c9')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16999ac2-b0, col_values=(('external_ids', {'iface-id': '16999ac2-b068-479b-a705-8342b29addc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:7b:57', 'vm-uuid': 'b1a7d533-cad6-4360-b6c4-f12c6fc473a8'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:45 user nova-compute[75288]: INFO os_vif [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0')
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No VIF found with MAC fa:16:3e:f8:7b:57, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.network.neutron [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updated VIF entry in instance network info cache for port 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.network.neutron [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updating instance_info_cache with network_info: [{"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7e756730-b73b-4ce9-8652-07bbb01025b3 req-7fbf3a51-4726-4290-9921-61a13ef154df service nova] Releasing lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'flavor' on Instance uuid 53c5e477-fbbc-416b-848c-c3afe9d2a1af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:46 user nova-compute[75288]: INFO nova.compute.manager [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Attaching volume b773e6ae-aea6-4e3d-bc77-d0dedf83881c to /dev/vdb
Nov 10 22:46:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee94b7d-d229-4e6f-850c-380a67cbe10a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ce34b-1309-4c3d-89e0-47a51d375abc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3fe4c1-79b7-47d1-b38d-45870286f31a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e2eca4-9ec4-4399-842a-d2fcf14fe3b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:46:46 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98cd4cd-4e1d-4a9f-af37-5ace604d4dac]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updating existing volume attachment record: 43448fe5-fad7-46e5-bcb5-96d64775f1a4 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-2c83af4a-a331-40e8-bfe0-81a13a35dc0c req-2e55892a-f466-4997-92bd-18adf8998a32 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2c83af4a-a331-40e8-bfe0-81a13a35dc0c req-2e55892a-f466-4997-92bd-18adf8998a32 service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2c83af4a-a331-40e8-bfe0-81a13a35dc0c req-2e55892a-f466-4997-92bd-18adf8998a32 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2c83af4a-a331-40e8-bfe0-81a13a35dc0c req-2e55892a-f466-4997-92bd-18adf8998a32 service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-2c83af4a-a331-40e8-bfe0-81a13a35dc0c req-2e55892a-f466-4997-92bd-18adf8998a32 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:46 user nova-compute[75288]: WARNING nova.compute.manager [req-2c83af4a-a331-40e8-bfe0-81a13a35dc0c req-2e55892a-f466-4997-92bd-18adf8998a32 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:46:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-b612e3a4-24d6-43e4-b82e-1a73068e039c req-4f0a17e3-da06-40b1-8d84-7e5993baba0b service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b612e3a4-24d6-43e4-b82e-1a73068e039c req-4f0a17e3-da06-40b1-8d84-7e5993baba0b service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b612e3a4-24d6-43e4-b82e-1a73068e039c req-4f0a17e3-da06-40b1-8d84-7e5993baba0b service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b612e3a4-24d6-43e4-b82e-1a73068e039c req-4f0a17e3-da06-40b1-8d84-7e5993baba0b service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-b612e3a4-24d6-43e4-b82e-1a73068e039c req-4f0a17e3-da06-40b1-8d84-7e5993baba0b service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:47 user nova-compute[75288]: WARNING nova.compute.manager [req-b612e3a4-24d6-43e4-b82e-1a73068e039c req-4f0a17e3-da06-40b1-8d84-7e5993baba0b service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received unexpected event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with vm_state building and task_state spawning.
Nov 10 22:46:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:48 user nova-compute[75288]: WARNING nova.compute.manager [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:46:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:48 user nova-compute[75288]: WARNING nova.compute.manager [req-2bd0e598-14bb-4be9-b39f-07941e3de5cf req-b48f28b2-6f2f-4598-b95b-e749d9e60aba service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:46:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d43b9481-9362-457d-a930-ad7bcec402df req-95cfae32-4eee-4cc7-9c41-359ad5a031bb service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d43b9481-9362-457d-a930-ad7bcec402df req-95cfae32-4eee-4cc7-9c41-359ad5a031bb service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d43b9481-9362-457d-a930-ad7bcec402df req-95cfae32-4eee-4cc7-9c41-359ad5a031bb service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d43b9481-9362-457d-a930-ad7bcec402df req-95cfae32-4eee-4cc7-9c41-359ad5a031bb service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d43b9481-9362-457d-a930-ad7bcec402df req-95cfae32-4eee-4cc7-9c41-359ad5a031bb service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:49 user nova-compute[75288]: WARNING nova.compute.manager [req-d43b9481-9362-457d-a930-ad7bcec402df req-95cfae32-4eee-4cc7-9c41-359ad5a031bb service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received unexpected event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with vm_state building and task_state spawning.
Nov 10 22:46:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bddf3ee9-7fca-49c2-adf1-2144991b45e3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:46:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance spawned successfully.
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:46:50 user nova-compute[75288]: INFO nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 10 22:46:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:46:50 user nova-compute[75288]: INFO nova.compute.manager [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Took 35.28 seconds to build instance.
Nov 10 22:46:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-884b2400-de8d-4f6d-bfc6-549c0b9f740f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.446s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Port 909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 binding to destination host user is already ACTIVE {{(pid=75288) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Creating tmpfile /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444/tmpxuwfriey to verify with other compute node that the instance is on the same shared storage. {{(pid=75288) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-7ea6ae50-9c6a-4fd0-adeb-fe9fc5f3c0a9 req-fad8a61c-147b-41e8-af39-ad5c1388e231 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-unplugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7ea6ae50-9c6a-4fd0-adeb-fe9fc5f3c0a9 req-fad8a61c-147b-41e8-af39-ad5c1388e231 service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7ea6ae50-9c6a-4fd0-adeb-fe9fc5f3c0a9 req-fad8a61c-147b-41e8-af39-ad5c1388e231 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7ea6ae50-9c6a-4fd0-adeb-fe9fc5f3c0a9 req-fad8a61c-147b-41e8-af39-ad5c1388e231 service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-7ea6ae50-9c6a-4fd0-adeb-fe9fc5f3c0a9 req-fad8a61c-147b-41e8-af39-ad5c1388e231 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-unplugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:54 user nova-compute[75288]: WARNING nova.compute.manager [req-7ea6ae50-9c6a-4fd0-adeb-fe9fc5f3c0a9 req-fad8a61c-147b-41e8-af39-ad5c1388e231 service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-unplugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state resized and task_state resize_reverting.
Nov 10 22:46:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance destroyed successfully.
Nov 10 22:46:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lazy-loading 'resources' on Instance uuid b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1763701259',display_name='tempest-ServerActionsTestOtherB-server-1763701259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1763701259',id=16,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuF/yviImHglYGIXiLmfbAvxX1/9/n49hx51CEU4vPIIK0cwYCFjIHSOmrYvu7mdk8fQPm8oJwZeKNCXTTt3FJg6Tq2wup2YgajWX6dwhMXP1Xwfv2hMNZnvwgRC226mA==',key_name='tempest-keypair-37753185',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='224fa7e9054147d4aa63826efaa17392',ramdisk_id='',reservation_id='r-hxndv4eh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-594854393',owner_user_name='tempest-ServerActionsTestOtherB-594854393-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c5517f32c04ad498f307b9b89c6a45',uuid=b9342997-048d-4f4f-a552-de76f2a0a444,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converting VIF {"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_vif [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap909c66a6-f3, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab1a0f5b-868d-4966-87f5-282c7813b397) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:54 user nova-compute[75288]: INFO os_vif [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3')
Nov 10 22:46:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:46:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4710980-d793-4847-a454-5d699551455f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:46:54 user nova-compute[75288]: No targets found.
Nov 10 22:46:54 user nova-compute[75288]: iSNS:
Nov 10 22:46:54 user nova-compute[75288]: No targets found.
Nov 10 22:46:54 user nova-compute[75288]: STATIC:
Nov 10 22:46:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:46:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:46:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:46:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:46:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:46:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:46:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248
Nov 10 22:46:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:46:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:46:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420
Nov 10 22:46:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:46:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:46:54 user nova-compute[75288]: FIRMWARE:
Nov 10 22:46:54 user nova-compute[75288]: No targets found.
Nov 10 22:46:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:46:54 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:46:54 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d1e3f1-ec39-45e6-86f4-aa2ca8159e77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a055699-de01-4be0-8655-40c86a6d4076]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:54 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:54 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:54 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:46:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:46:54 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 (non-flash)
Nov 10 22:46:54 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:46:54 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:46:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b104e3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c4b24-2249-454e-9daf-8dad073f2ff0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[850d85e4-2d87-49f5-b543-d10647b03988]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548e92d-4b54-41ea-bc93-b13234ab2df2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e174f0-9c8d-41b9-80ee-ee9a756c35bd]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc38ebc-443b-473b-a791-6df1f58722a9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb15be4-7030-4698-83a8-1e53e108a712]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260]
Nov 10 22:46:55 user nova-compute[75288]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420, portal: 172.16.0.220,3260] successful.
Nov 10 22:46:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f30fb-f35f-49aa-93b1-162e56bdd314]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== disconnect_volume: return (371ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:46:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:46:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-cf6c4390-a9bf-4b3a-8423-0776585fca6d req-118d2589-2415-490f-8d59-39f3d10803bd service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cf6c4390-a9bf-4b3a-8423-0776585fca6d req-118d2589-2415-490f-8d59-39f3d10803bd service nova] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cf6c4390-a9bf-4b3a-8423-0776585fca6d req-118d2589-2415-490f-8d59-39f3d10803bd service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cf6c4390-a9bf-4b3a-8423-0776585fca6d req-118d2589-2415-490f-8d59-39f3d10803bd service nova] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-cf6c4390-a9bf-4b3a-8423-0776585fca6d req-118d2589-2415-490f-8d59-39f3d10803bd service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] No waiting events found dispatching network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:46:56 user nova-compute[75288]: WARNING nova.compute.manager [req-cf6c4390-a9bf-4b3a-8423-0776585fca6d req-118d2589-2415-490f-8d59-39f3d10803bd service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received unexpected event network-vif-plugged-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 for instance with vm_state resized and task_state resize_reverting.
Nov 10 22:46:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:46:59 user nova-compute[75288]: INFO nova.compute.manager [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Terminating instance
Nov 10 22:46:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-da4300d6-45c3-47cb-a95f-201175b5a8fa req-e7ab433b-0607-49e1-9a54-8243a6a86c37 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-vif-unplugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da4300d6-45c3-47cb-a95f-201175b5a8fa req-e7ab433b-0607-49e1-9a54-8243a6a86c37 service nova] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da4300d6-45c3-47cb-a95f-201175b5a8fa req-e7ab433b-0607-49e1-9a54-8243a6a86c37 service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da4300d6-45c3-47cb-a95f-201175b5a8fa req-e7ab433b-0607-49e1-9a54-8243a6a86c37 service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-da4300d6-45c3-47cb-a95f-201175b5a8fa req-e7ab433b-0607-49e1-9a54-8243a6a86c37 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] No waiting events found dispatching network-vif-unplugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-da4300d6-45c3-47cb-a95f-201175b5a8fa req-e7ab433b-0607-49e1-9a54-8243a6a86c37 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-vif-unplugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Instance destroyed successfully.
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lazy-loading 'resources' on Instance uuid 054f3333-ecb7-4705-9b83-1f42e6cb90fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1978425707',display_name='tempest-ServersNegativeTestJSON-server-1978425707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1978425707',id=25,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef52a00aba2b48d5904eda97ecc89861',ramdisk_id='',reservation_id='r-29hm9tq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-891085347',owner_user_name='tempest-ServersNegativeTestJSON-891085347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:45:18Z,user_data=None,user_id='b1b51c6d64044e57b9afcc85619c88e6',uuid=054f3333-ecb7-4705-9b83-1f42e6cb90fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converting VIF {"id": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "address": "fa:16:3e:ae:b2:de", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8e948c-f9", "ovs_interfaceid": "1d8e948c-f9fd-4917-b90d-799b5892fb01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b2:de,bridge_name='br-int',has_traffic_filtering=True,id=1d8e948c-f9fd-4917-b90d-799b5892fb01,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e948c-f9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG os_vif [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b2:de,bridge_name='br-int',has_traffic_filtering=True,id=1d8e948c-f9fd-4917-b90d-799b5892fb01,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e948c-f9') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d8e948c-f9, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee37298f-8b84-45b2-94ae-e8175d854cc6) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:47:00 user nova-compute[75288]: INFO os_vif [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b2:de,bridge_name='br-int',has_traffic_filtering=True,id=1d8e948c-f9fd-4917-b90d-799b5892fb01,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8e948c-f9')
Nov 10 22:47:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Deleting instance files /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd_del
Nov 10 22:47:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Deletion of /opt/stack/data/nova/instances/054f3333-ecb7-4705-9b83-1f42e6cb90fd_del complete
Nov 10 22:47:00 user nova-compute[75288]: INFO nova.compute.manager [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 10 22:47:00 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:01 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:47:01 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Took 0.63 seconds to deallocate network for instance.
Nov 10 22:47:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-08d49fcc-31ce-461e-b946-fe93c8ea9d94 req-66468762-612b-4329-a793-c77ce3ee3041 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-vif-deleted-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:47:01 user nova-compute[75288]: INFO nova.compute.manager [req-08d49fcc-31ce-461e-b946-fe93c8ea9d94 req-66468762-612b-4329-a793-c77ce3ee3041 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Neutron deleted interface 1d8e948c-f9fd-4917-b90d-799b5892fb01; detaching it from the instance and deleting it from the info cache
Nov 10 22:47:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-08d49fcc-31ce-461e-b946-fe93c8ea9d94 req-66468762-612b-4329-a793-c77ce3ee3041 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:47:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-08d49fcc-31ce-461e-b946-fe93c8ea9d94 req-66468762-612b-4329-a793-c77ce3ee3041 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Detach interface failed, port_id=1d8e948c-f9fd-4917-b90d-799b5892fb01, reason: Instance 054f3333-ecb7-4705-9b83-1f42e6cb90fd could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.574s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] No waiting events found dispatching network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:47:02 user nova-compute[75288]: WARNING nova.compute.manager [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received unexpected event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 for instance with vm_state deleted and task_state None.
Nov 10 22:47:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] Acquiring lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] No waiting events found dispatching network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:47:02 user nova-compute[75288]: WARNING nova.compute.manager [req-0b0a94f7-a43f-42aa-a92d-5f1c3f1250a8 req-a5e84f39-0744-4b30-bde1-44701cf72f43 service nova] [instance: 054f3333-ecb7-4705-9b83-1f42e6cb90fd] Received unexpected event network-vif-plugged-1d8e948c-f9fd-4917-b90d-799b5892fb01 for instance with vm_state deleted and task_state None.
Nov 10 22:47:02 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Deleted allocations for instance 054f3333-ecb7-4705-9b83-1f42e6cb90fd
Nov 10 22:47:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e5a1ee16-5967-4c9d-9747-41f40db61cbe tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "054f3333-ecb7-4705-9b83-1f42e6cb90fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.581s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lazy-loading 'migration_context' on Instance uuid b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG nova.objects.base [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Object Instance<b9342997-048d-4f4f-a552-de76f2a0a444> lazy-loaded attributes: resources,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUgxiTmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:47:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:47:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:47:16 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1408a476-6b75-4eb1-b741-d665cb629ce5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:47:16 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bf345c-708f-44d9-800f-96207164e085]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c] added
Nov 10 22:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c908b-50ff-4043-a8c1-110494944884]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[107113e5-c384-4a0b-95b9-c4ee49366d41]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUgxiTmz {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUgxiTmz" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2504382-fdd4-445d-80f4-d0fc8c92a82b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUgxiTmz'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[292e3c5e-72c8-496a-aeb7-d8bc23ecba5f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cef5da8-8ca5-4bd3-9f8a-0c3352d872f3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.624s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7485f5e6-9c67-47a8-a8f1-bd65a070d9e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260]
Nov 10 22:47:16 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260] successful.
Nov 10 22:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e24965a-42fe-40c3-a1e2-d2a37c79c127]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3a7ffa-745d-47f1-84e6-2454554598ed]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)
Nov 10 22:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:16 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)
Nov 10 22:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c851221-b476-4945-93bf-dfcb8e62d436]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:47:17 user nova-compute[75288]: INFO nova.compute.manager [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Swapping old allocation on dict_keys(['b11c524c-1236-4192-b3e8-15e79f5f3ca6']) held by migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d for instance
Nov 10 22:47:17 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Overwriting current allocation {'allocations': {'b11c524c-1236-4192-b3e8-15e79f5f3ca6': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 33}}, 'project_id': '224fa7e9054147d4aa63826efaa17392', 'user_id': '18c5517f32c04ad498f307b9b89c6a45', 'consumer_generation': 1} on consumer b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquired lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [{"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Releasing lock "refresh_cache-b9342997-048d-4f4f-a552-de76f2a0a444" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG os_brick.utils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17858c3-548f-4070-b484-49fa6bf8e57c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b253c5a-3b02-44cc-85b6-ecdecc87e5b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e2c9b1-fba7-4ba9-89d7-4fbb8dd94f41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86a2c76-930d-4f24-a35a-f54e36bc0ca4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:47:17 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:47:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffad575-9123-4df0-accf-284deea9a644]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:47:17 user nova-compute[75288]: DEBUG os_brick.utils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUgxiTmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26663343136376564', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663343136376564', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'flavor' on Instance uuid 53c5e477-fbbc-416b-848c-c3afe9d2a1af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:47:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:47:18 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:47:18 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:47:18 user nova-compute[75288]:   <serial>b773e6ae-aea6-4e3d-bc77-d0dedf83881c</serial>
Nov 10 22:47:18 user nova-compute[75288]: </disk>
Nov 10 22:47:18 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] No VIF found with MAC fa:16:3e:db:85:f0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-02d7b9bb-2cd7-4685-a62a-714c32a710b1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.522s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:19 user nova-compute[75288]: INFO nova.compute.manager [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Detaching volume 63f3c4f4-e73d-4a9a-ada5-39212124e248
Nov 10 22:47:19 user nova-compute[75288]: INFO nova.virt.block_device [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attempting to driver detach volume 63f3c4f4-e73d-4a9a-ada5-39212124e248 from mountpoint /dev/vdb
Nov 10 22:47:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Attempting to detach device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:47:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:47:19 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:47:19 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:47:19 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:47:19 user nova-compute[75288]:   <serial>63f3c4f4-e73d-4a9a-ada5-39212124e248</serial>
Nov 10 22:47:19 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:47:19 user nova-compute[75288]: </disk>
Nov 10 22:47:19 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:47:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config.
Nov 10 22:47:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:47:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:47:19 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:47:19 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:47:19 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:47:19 user nova-compute[75288]:   <serial>63f3c4f4-e73d-4a9a-ada5-39212124e248</serial>
Nov 10 22:47:19 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:47:19 user nova-compute[75288]: </disk>
Nov 10 22:47:19 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:47:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:20 user nova-compute[75288]: INFO nova.compute.manager [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Detaching volume b773e6ae-aea6-4e3d-bc77-d0dedf83881c
Nov 10 22:47:20 user nova-compute[75288]: INFO nova.virt.block_device [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Attempting to driver detach volume b773e6ae-aea6-4e3d-bc77-d0dedf83881c from mountpoint /dev/vdb
Nov 10 22:47:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Attempting to detach device vdb from instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:47:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:47:20 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:47:20 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:47:20 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:47:20 user nova-compute[75288]:   <serial>b773e6ae-aea6-4e3d-bc77-d0dedf83881c</serial>
Nov 10 22:47:20 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:47:20 user nova-compute[75288]: </disk>
Nov 10 22:47:20 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:47:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully detached device vdb from instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af from the persistent domain config.
Nov 10 22:47:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:47:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:47:20 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:47:20 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:47:20 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:47:20 user nova-compute[75288]:   <serial>b773e6ae-aea6-4e3d-bc77-d0dedf83881c</serial>
Nov 10 22:47:20 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:47:20 user nova-compute[75288]: </disk>
Nov 10 22:47:20 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:47:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:47:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:47:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:47:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:47:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:47:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:30 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:47:30 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7264MB free_disk=24.969043731689453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 42be4921-aac5-4ee5-9564-455e9558ded0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:47:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:47:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:47:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:47:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 is timed out.
Nov 10 22:47:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config.
Nov 10 22:47:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSbuCGPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:47:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb82b42-1130-4d24-b54a-cf6b29c47803]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:47:40 user nova-compute[75288]: No targets found.
Nov 10 22:47:40 user nova-compute[75288]: iSNS:
Nov 10 22:47:40 user nova-compute[75288]: No targets found.
Nov 10 22:47:40 user nova-compute[75288]: STATIC:
Nov 10 22:47:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c
Nov 10 22:47:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:47:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:47:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:47:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:47:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:47:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:47:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:47:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:47:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248
Nov 10 22:47:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:47:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:47:40 user nova-compute[75288]: FIRMWARE:
Nov 10 22:47:40 user nova-compute[75288]: No targets found.
Nov 10 22:47:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:47:40 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:47:40 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d8660-cf38-4862-af20-2c5921f840be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09700b2-5b8a-4ced-bbda-cd31a07da55e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:40 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:47:40 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:40 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)
Nov 10 22:47:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:40 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 (non-flash)
Nov 10 22:47:40 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:40 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)
Nov 10 22:47:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b1010edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[feab11a6-e142-4313-aa24-ba9ae9773fa6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3007d93-148b-40f1-bcf6-237c9c7a4e15]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b32e1e-5d5f-4878-b092-5be677234202]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2228b295-ffa3-459c-9921-3341f42e3c53]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f487f395-06f6-4f53-ba01-796dd1a768c5]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3674f06-f6f5-4343-8c07-0864fd0845de]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260]
Nov 10 22:47:40 user nova-compute[75288]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248, portal: 172.16.0.220,3260] successful.
Nov 10 22:47:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f3c4f4-e73d-4a9a-ada5-39212124e248 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05603ee5-f5d6-4155-b121-f3850d860c5b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== disconnect_volume: return (337ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af is timed out.
Nov 10 22:47:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully detached device vdb from instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af from the live domain config.
Nov 10 22:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUgxiTmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:47:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba955988-b315-494e-8819-b59520a14602]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:47:41 user nova-compute[75288]: No targets found.
Nov 10 22:47:41 user nova-compute[75288]: iSNS:
Nov 10 22:47:41 user nova-compute[75288]: No targets found.
Nov 10 22:47:41 user nova-compute[75288]: STATIC:
Nov 10 22:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c
Nov 10 22:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:47:41 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:47:41 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:47:41 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:47:41 user nova-compute[75288]: FIRMWARE:
Nov 10 22:47:41 user nova-compute[75288]: No targets found.
Nov 10 22:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:47:41 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:47:41 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee0dfbc-e003-4f3a-89d5-599b80a398e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[765046f3-fcd7-432f-9488-ab6109c6d753]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:41 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:41 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)
Nov 10 22:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:47:41 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:47:41 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c (non-flash)
Nov 10 22:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10355990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0809406e-9dea-413e-a70f-af4a41fa910f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afb5aea-e414-4ebc-8e66-d28c8c456b58]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abece5e-7b53-4561-a98a-b5ec27e3c2e3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d64b0a-c1a0-4a19-bde5-725805e70312]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0c23ac-b798-49d4-a6ad-5a8aecca1159]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a0cb91-33fc-4309-b402-3afad14f7c9a]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260]
Nov 10 22:47:41 user nova-compute[75288]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c, portal: 172.16.0.220,3260] successful.
Nov 10 22:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b773e6ae-aea6-4e3d-bc77-d0dedf83881c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3830c584-d24f-429e-b47c-b54995f664c0]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] <== disconnect_volume: return (306ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c1f4a0c-d646-4e07-bf2f-73b8e24d51d6 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.138s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'flavor' on Instance uuid 53c5e477-fbbc-416b-848c-c3afe9d2a1af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-766f7c3b-80dc-4e80-abea-682216e7e9f9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:42 user nova-compute[75288]: INFO nova.compute.manager [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Terminating instance
Nov 10 22:47:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.volume.cinder [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Update attachment failed for attachment d06c49d9-afca-4a1b-9629-6717afed30bc. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cae22798-f1f0-4028-8c8d-4108654fe9ca) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cae22798-f1f0-4028-8c8d-4108654fe9ca)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cae22798-f1f0-4028-8c8d-4108654fe9ca)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Traceback (most recent call last):
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     yield
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/nova/nova/compute/manager.py", line 5486, in _finish_revert_resize
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     self._update_volume_attachments(context, instance, bdms)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     self.volume_api.attachment_update(
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     res = method(self, ctx, *args, **kwargs)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     with excutils.save_and_reraise_exception():
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     self.force_reraise()
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     raise self.value
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     return method.func(obj, *args, **kwargs)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     resp = self._update('/attachments/%s' % id, body)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     return self.request(url, method, **kwargs)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444]     raise exceptions.from_response(resp, body)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cae22798-f1f0-4028-8c8d-4108654fe9ca)
Nov 10 22:47:42 user nova-compute[75288]: ERROR nova.compute.manager [instance: b9342997-048d-4f4f-a552-de76f2a0a444] 
Nov 10 22:47:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b546c20-1de6-48a7-b87a-3d00d7217f32 req-394bc051-e56e-4129-808c-2d533a3e937f service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-unplugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b546c20-1de6-48a7-b87a-3d00d7217f32 req-394bc051-e56e-4129-808c-2d533a3e937f service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b546c20-1de6-48a7-b87a-3d00d7217f32 req-394bc051-e56e-4129-808c-2d533a3e937f service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b546c20-1de6-48a7-b87a-3d00d7217f32 req-394bc051-e56e-4129-808c-2d533a3e937f service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b546c20-1de6-48a7-b87a-3d00d7217f32 req-394bc051-e56e-4129-808c-2d533a3e937f service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-unplugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:47:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b546c20-1de6-48a7-b87a-3d00d7217f32 req-394bc051-e56e-4129-808c-2d533a3e937f service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-unplugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:47:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Instance destroyed successfully.
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lazy-loading 'resources' on Instance uuid 42be4921-aac5-4ee5-9564-455e9558ded0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-348158825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-348158825',id=19,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl3bnDr6iWD2rDxViaXHLOHvBAxs6kgwoH4KHi0DyqdB+X0ShLlFByhguU1fNi4/if+gomSn7bK/KT9k2KIha7W5cZLDZnZLRjdK9prTch89nrolMuTJz6JRNi6ZY3J9g==',key_name='tempest-keypair-276005353',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:46:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53f6c30d0f1a467f8e977a73463e2d1e',ramdisk_id='',reservation_id='r-lihpwz8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618351090',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618351090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05f170ae42004d57abea1bf318d05dab',uuid=42be4921-aac5-4ee5-9564-455e9558ded0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converting VIF {"id": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "address": "fa:16:3e:0b:1a:e4", "network": {"id": "8e111d22-7865-423b-baaf-05af1eace654", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-808243420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f6c30d0f1a467f8e977a73463e2d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004daad5-a7", "ovs_interfaceid": "004daad5-a7a8-4929-8faf-aa904b1c2bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG os_vif [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap004daad5-a7, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=264ddf05-99cc-4900-b17e-7da204ae4241) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:47:43 user nova-compute[75288]: INFO os_vif [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1a:e4,bridge_name='br-int',has_traffic_filtering=True,id=004daad5-a7a8-4929-8faf-aa904b1c2bb4,network=Network(8e111d22-7865-423b-baaf-05af1eace654),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004daad5-a7')
Nov 10 22:47:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Deleting instance files /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0_del
Nov 10 22:47:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Deletion of /opt/stack/data/nova/instances/42be4921-aac5-4ee5-9564-455e9558ded0_del complete
Nov 10 22:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:43 user nova-compute[75288]: INFO nova.compute.manager [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 10 22:47:43 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:43 user nova-compute[75288]: INFO nova.compute.manager [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Successfully reverted task state from resize_reverting on failure for instance.
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server [None req-d952d182-8f50-4f61-a829-32b85756ce91 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cae22798-f1f0-4028-8c8d-4108654fe9ca)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 5420, in finish_revert_resize
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._finish_revert_resize(
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 5486, in _finish_revert_resize
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cae22798-f1f0-4028-8c8d-4108654fe9ca)
Nov 10 22:47:43 user nova-compute[75288]: ERROR oslo_messaging.rpc.server 
Nov 10 22:47:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:47:44 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Took 0.79 seconds to deallocate network for instance.
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9900af4-55a9-4d35-84b9-2fef9d3c0481 req-c52e90d2-dda9-4e0e-b49f-5f5d352ddf44 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-deleted-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:47:44 user nova-compute[75288]: INFO nova.compute.manager [req-b9900af4-55a9-4d35-84b9-2fef9d3c0481 req-c52e90d2-dda9-4e0e-b49f-5f5d352ddf44 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Neutron deleted interface 004daad5-a7a8-4929-8faf-aa904b1c2bb4; detaching it from the instance and deleting it from the info cache
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-b9900af4-55a9-4d35-84b9-2fef9d3c0481 req-c52e90d2-dda9-4e0e-b49f-5f5d352ddf44 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9900af4-55a9-4d35-84b9-2fef9d3c0481 req-c52e90d2-dda9-4e0e-b49f-5f5d352ddf44 service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Detach interface failed, port_id=004daad5-a7a8-4929-8faf-aa904b1c2bb4, reason: Instance 42be4921-aac5-4ee5-9564-455e9558ded0 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.715s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:44 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Deleted allocations for instance 42be4921-aac5-4ee5-9564-455e9558ded0
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-7b85bccc-0b4c-4294-89b4-3b98db538f49 req-7a666cd0-16e8-4a65-8dca-4e377752c51a service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7b85bccc-0b4c-4294-89b4-3b98db538f49 req-7a666cd0-16e8-4a65-8dca-4e377752c51a service nova] Acquiring lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7b85bccc-0b4c-4294-89b4-3b98db538f49 req-7a666cd0-16e8-4a65-8dca-4e377752c51a service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7b85bccc-0b4c-4294-89b4-3b98db538f49 req-7a666cd0-16e8-4a65-8dca-4e377752c51a service nova] Lock "42be4921-aac5-4ee5-9564-455e9558ded0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-7b85bccc-0b4c-4294-89b4-3b98db538f49 req-7a666cd0-16e8-4a65-8dca-4e377752c51a service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] No waiting events found dispatching network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:47:44 user nova-compute[75288]: WARNING nova.compute.manager [req-7b85bccc-0b4c-4294-89b4-3b98db538f49 req-7a666cd0-16e8-4a65-8dca-4e377752c51a service nova] [instance: 42be4921-aac5-4ee5-9564-455e9558ded0] Received unexpected event network-vif-plugged-004daad5-a7a8-4929-8faf-aa904b1c2bb4 for instance with vm_state deleted and task_state None.
Nov 10 22:47:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8d01ed98-914d-4421-9a3f-4302411808b0 tempest-AttachVolumeShelveTestJSON-1618351090 tempest-AttachVolumeShelveTestJSON-1618351090-project-member] Lock "42be4921-aac5-4ee5-9564-455e9558ded0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.466s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:47:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:47:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:47:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:47:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:47:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:47:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-changed-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Refreshing instance network info cache due to event network-changed-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:48:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:48:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:48:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Refreshing network info cache for port b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:48:07 user nova-compute[75288]: DEBUG nova.network.neutron [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updated VIF entry in instance network info cache for port b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:48:07 user nova-compute[75288]: DEBUG nova.network.neutron [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37a0be62-92c6-4083-af21-21d791cfefde req-14e778ca-98dd-4b0c-a6cd-010a5effb191 service nova] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Stashing vm_state: active {{(pid=75288) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:48:08 user nova-compute[75288]: INFO nova.compute.claims [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Claim successful on node user
Nov 10 22:48:08 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating resource usage from migration 25dbea36-6a51-420a-929c-ae6ea630bef0
Nov 10 22:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-changed-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Refreshing instance network info cache due to event network-changed-16999ac2-b068-479b-a705-8342b29addc7. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] Acquiring lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] Acquired lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Refreshing network info cache for port 16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.493s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:08 user nova-compute[75288]: INFO nova.compute.manager [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Migrating
Nov 10 22:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updated VIF entry in instance network info cache for port 16999ac2-b068-479b-a705-8342b29addc7. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating instance_info_cache with network_info: [{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f4da0413-752a-41fb-ba38-9d98566c1046 req-9c479d7e-32e2-4a44-94d8-e77cf30b6a86 service nova] Releasing lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquired lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating instance_info_cache with network_info: [{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Releasing lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Starting migrate_disk_and_power_off {{(pid=75288) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fbf05cc-5fdf-4ca7-969f-e6d523e7b05c req-2588f33e-275b-47cf-95fc-56e0780cd545 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-unplugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fbf05cc-5fdf-4ca7-969f-e6d523e7b05c req-2588f33e-275b-47cf-95fc-56e0780cd545 service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fbf05cc-5fdf-4ca7-969f-e6d523e7b05c req-2588f33e-275b-47cf-95fc-56e0780cd545 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fbf05cc-5fdf-4ca7-969f-e6d523e7b05c req-2588f33e-275b-47cf-95fc-56e0780cd545 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fbf05cc-5fdf-4ca7-969f-e6d523e7b05c req-2588f33e-275b-47cf-95fc-56e0780cd545 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-unplugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:10 user nova-compute[75288]: WARNING nova.compute.manager [req-7fbf05cc-5fdf-4ca7-969f-e6d523e7b05c req-2588f33e-275b-47cf-95fc-56e0780cd545 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received unexpected event network-vif-unplugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with vm_state active and task_state resize_migrating.
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance destroyed successfully.
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1858541466',display_name='tempest-ServerActionsTestOtherA-server-1858541466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1858541466',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ez96icqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=b1a7d533-cad6-4360-b6c4-f12c6fc473a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-215817591-network", "vif_mac": "fa:16:3e:f8:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-215817591-network", "vif_mac": "fa:16:3e:f8:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_vif [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16999ac2-b0, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff0dd9d5-c73f-4ea6-934f-a09b234b29c9) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:10 user nova-compute[75288]: INFO os_vif [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0')
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f61f7f-d051-47a1-9b11-27959c0de357]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:48:10 user nova-compute[75288]: No targets found.
Nov 10 22:48:10 user nova-compute[75288]: iSNS:
Nov 10 22:48:10 user nova-compute[75288]: No targets found.
Nov 10 22:48:10 user nova-compute[75288]: STATIC:
Nov 10 22:48:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:48:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:48:10 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:48:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:48:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:48:10 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:48:10 user nova-compute[75288]: FIRMWARE:
Nov 10 22:48:10 user nova-compute[75288]: No targets found.
Nov 10 22:48:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:48:10 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:48:10 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a95ec8a-0092-4f2a-a670-a04ce5fad0c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[63548167-296b-4abc-a99c-d32d5b4d4ff5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:48:10 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:48:10 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b202f9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce0c35c-bad5-460f-a0a9-46ad3e2f090e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c65cac-3180-4b22-ab31-3340200adbe9]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[931add69-fb5c-475b-96b9-ed844840e3ff]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3a4a8f-9dfd-4e04-97b2-9982028dcfeb]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa108d4d0-0f31c65510296426', '/dev/disk/by-id/scsi-23066333163363535', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a108d4d0') {{(pid=86709) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb44fe1-355b-4431-8dc2-ea7376520d16]: (4, None) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[51449705-c102-4264-bda5-2cfc4fb37246]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c57a30-3f97-4eb7-9d2d-3d97270211ec]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]
Nov 10 22:48:10 user nova-compute[75288]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.
Nov 10 22:48:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[55735d57-6c1e-4da8-a361-005487fa8fe9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== disconnect_volume: return (341ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:48:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-changed-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Refreshing instance network info cache due to event network-changed-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] Acquiring lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] Acquired lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Refreshing network info cache for port 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:11 user nova-compute[75288]: INFO nova.compute.manager [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Terminating instance
Nov 10 22:48:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-e89c6025-cc43-49f8-a3a8-a2a7937e6a38 req-bc3e957c-7554-4447-a67c-c3c7152a0800 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-vif-unplugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e89c6025-cc43-49f8-a3a8-a2a7937e6a38 req-bc3e957c-7554-4447-a67c-c3c7152a0800 service nova] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e89c6025-cc43-49f8-a3a8-a2a7937e6a38 req-bc3e957c-7554-4447-a67c-c3c7152a0800 service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e89c6025-cc43-49f8-a3a8-a2a7937e6a38 req-bc3e957c-7554-4447-a67c-c3c7152a0800 service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-e89c6025-cc43-49f8-a3a8-a2a7937e6a38 req-bc3e957c-7554-4447-a67c-c3c7152a0800 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] No waiting events found dispatching network-vif-unplugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-e89c6025-cc43-49f8-a3a8-a2a7937e6a38 req-bc3e957c-7554-4447-a67c-c3c7152a0800 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-vif-unplugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updated VIF entry in instance network info cache for port 197ddcca-4bb3-423d-ab94-f43c9ae0f3f6. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updating instance_info_cache with network_info: [{"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-48195b16-c15c-4670-8425-4ce4873bb3c4 req-95292015-7a71-474e-8b13-22b50a1fe44a service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-48195b16-c15c-4670-8425-4ce4873bb3c4 req-95292015-7a71-474e-8b13-22b50a1fe44a service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-48195b16-c15c-4670-8425-4ce4873bb3c4 req-95292015-7a71-474e-8b13-22b50a1fe44a service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-48195b16-c15c-4670-8425-4ce4873bb3c4 req-95292015-7a71-474e-8b13-22b50a1fe44a service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-48195b16-c15c-4670-8425-4ce4873bb3c4 req-95292015-7a71-474e-8b13-22b50a1fe44a service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:12 user nova-compute[75288]: WARNING nova.compute.manager [req-48195b16-c15c-4670-8425-4ce4873bb3c4 req-95292015-7a71-474e-8b13-22b50a1fe44a service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received unexpected event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with vm_state active and task_state resize_migrating.
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bee824f6-a19d-4e97-9ddb-992dc7ae9b65 req-21a6b2ca-8830-4549-a1c2-5caa735fb5cb service nova] Releasing lock "refresh_cache-53c5e477-fbbc-416b-848c-c3afe9d2a1af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Port 16999ac2-b068-479b-a705-8342b29addc7 binding to destination host user is already ACTIVE {{(pid=75288) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 22:48:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Instance destroyed successfully.
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'resources' on Instance uuid 53c5e477-fbbc-416b-848c-c3afe9d2a1af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-958957965',display_name='tempest-TestStampPattern-server-958957965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-958957965',id=24,image_ref='ab52a32b-6403-4d4d-bdc8-520a11121881',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhOyHQ/mMcppCwCJUcBtZB9RAsC8DcDZYbZel44qDgENac/guD67yMkwHCAMOuJ/b/WnIA9XMdWVs2PHqnRCV/vU+mu+EYcKal9GrSkHUYouqZemEhNE4qY9vOyDF7nA==',key_name='tempest-TestStampPattern-1399113466',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f2f4e0a73b542a8a78c748a4d1c5914',ramdisk_id='',reservation_id='r-9ablp93i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='70c0e693-25bf-45bb-80b8-a3829e58a067',image_min_disk='1',image_min_ram='0',image_owner_id='3f2f4e0a73b542a8a78c748a4d1c5914',image_owner_project_name='tempest-TestStampPattern-2137207160',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2137207160-project-member',image_user_id='824744a11e9d4e4d9095fb0558632e00',owner_project_name='tempest-TestStampPattern-2137207160',owner_user_name='tempest-TestStampPattern-2137207160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:45:03Z,user_data=None,user_id='824744a11e9d4e4d9095fb0558632e00',uuid=53c5e477-fbbc-416b-848c-c3afe9d2a1af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converting VIF {"id": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "address": "fa:16:3e:db:85:f0", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ddcca-4b", "ovs_interfaceid": "197ddcca-4bb3-423d-ab94-f43c9ae0f3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:85:f0,bridge_name='br-int',has_traffic_filtering=True,id=197ddcca-4bb3-423d-ab94-f43c9ae0f3f6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ddcca-4b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG os_vif [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:85:f0,bridge_name='br-int',has_traffic_filtering=True,id=197ddcca-4bb3-423d-ab94-f43c9ae0f3f6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ddcca-4b') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap197ddcca-4b, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76e41930-79af-448f-a197-30487afacca1) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:12 user nova-compute[75288]: INFO os_vif [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:85:f0,bridge_name='br-int',has_traffic_filtering=True,id=197ddcca-4bb3-423d-ab94-f43c9ae0f3f6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ddcca-4b')
Nov 10 22:48:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Deleting instance files /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af_del
Nov 10 22:48:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Deletion of /opt/stack/data/nova/instances/53c5e477-fbbc-416b-848c-c3afe9d2a1af_del complete
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:12 user nova-compute[75288]: INFO nova.compute.manager [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquired lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:48:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating instance_info_cache with network_info: [{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Releasing lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG os_brick.utils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76b9b27-5e1e-4898-8bfa-6ae529c1cdf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fda319-5cc8-4bed-a43b-dbe107fa0226]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef0365a-06ef-476f-94d5-e93653d5d7b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f010ead3-f776-4d73-8bc5-2ffdca5551a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:48:13 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfd9153-8208-43db-a0c2-9aae60daa0e9]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG os_brick.utils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:13 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Took 0.86 seconds to deallocate network for instance.
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:13 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:48:14 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:48:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-4c66e8d2-a4cc-41f4-bcf1-ecd30735a081 req-a11fb985-da2a-4215-9b50-221e70842309 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4c66e8d2-a4cc-41f4-bcf1-ecd30735a081 req-a11fb985-da2a-4215-9b50-221e70842309 service nova] Acquiring lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4c66e8d2-a4cc-41f4-bcf1-ecd30735a081 req-a11fb985-da2a-4215-9b50-221e70842309 service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4c66e8d2-a4cc-41f4-bcf1-ecd30735a081 req-a11fb985-da2a-4215-9b50-221e70842309 service nova] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-4c66e8d2-a4cc-41f4-bcf1-ecd30735a081 req-a11fb985-da2a-4215-9b50-221e70842309 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] No waiting events found dispatching network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:14 user nova-compute[75288]: WARNING nova.compute.manager [req-4c66e8d2-a4cc-41f4-bcf1-ecd30735a081 req-a11fb985-da2a-4215-9b50-221e70842309 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received unexpected event network-vif-plugged-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 for instance with vm_state deleted and task_state None.
Nov 10 22:48:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-4c66e8d2-a4cc-41f4-bcf1-ecd30735a081 req-a11fb985-da2a-4215-9b50-221e70842309 service nova] [instance: 53c5e477-fbbc-416b-848c-c3afe9d2a1af] Received event network-vif-deleted-197ddcca-4bb3-423d-ab94-f43c9ae0f3f6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:14 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Deleted allocations for instance 53c5e477-fbbc-416b-848c-c3afe9d2a1af
Nov 10 22:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45007587-64f2-48c5-ac7b-2fcd1556e2d1 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "53c5e477-fbbc-416b-848c-c3afe9d2a1af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:17 user nova-compute[75288]: INFO nova.compute.manager [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attaching volume a298d0a1-97d8-48d6-bea6-7a92937ea28e to /dev/vdb
Nov 10 22:48:17 user nova-compute[75288]: DEBUG os_brick.utils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7601e346-42c2-453c-8844-020cfa9d89e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f8f4e8-34c1-48d9-8d45-babcc2c4c8a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30b7607-5447-4bb9-bee7-be93bb298c1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[355baefa-80d2-49e7-9a76-f67ed2efd240]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:48:17 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:48:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb98dd-e69a-4e4d-9779-93fef8059271]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG os_brick.utils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating existing volume attachment record: 0a1af914-a5c4-43c8-9383-a44692f3b07b {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:48:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:22 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:48:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:48:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:48:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:48:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updating instance_info_cache with network_info: [{"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-9bb377b7-e5a5-480f-9dd9-7d4e650841eb" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:48:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-changed-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Refreshing instance network info cache due to event network-changed-712a83c2-bcc4-4e16-974c-9b40d6b237aa. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] Acquiring lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] Acquired lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Refreshing network info cache for port 712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updated VIF entry in instance network info cache for port 712a83c2-bcc4-4e16-974c-9b40d6b237aa. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updating instance_info_cache with network_info: [{"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4dc1899d-70ab-4a9d-aabc-1939e0c9ee62 req-4229b1c1-9ee2-49f3-973c-a00826960717 service nova] Releasing lock "refresh_cache-f6b48e8c-3cc2-4121-84fe-ae84fcae327d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:30 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:48:30 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7901MB free_disk=24.987224578857422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Applying migration context for instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 as it has an incoming, in-progress migration 25dbea36-6a51-420a-929c-ae6ea630bef0. Migration status is post-migrating {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Applying migration context for instance b9342997-048d-4f4f-a552-de76f2a0a444 as it has an incoming, in-progress migration e1ef8db9-5b9a-4d21-b149-4af2ae1bea6d. Migration status is error {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=75288) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 10 22:48:30 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating resource usage from migration 25dbea36-6a51-420a-929c-ae6ea630bef0
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b9342997-048d-4f4f-a552-de76f2a0a444 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Migration 25dbea36-6a51-420a-929c-ae6ea630bef0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:48:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG nova.objects.instance [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:31 user nova-compute[75288]: INFO nova.compute.manager [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Attaching volume f641fb9e-0968-47a8-8f67-266211e20da8 to /dev/vdb
Nov 10 22:48:31 user nova-compute[75288]: DEBUG os_brick.utils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b6554b-e15c-49fb-9d51-392ac9fe9081]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1f2910-e053-465c-8adc-207242ed40ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa293abd-d8e4-4fe7-9e90-62c5b5317520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16bbb54-0022-4b68-8708-8e3efbe8bd2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:48:31 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:48:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a700a1b-d4d9-4104-9864-4ab75935c478]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG os_brick.utils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:31 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updating existing volume attachment record: eb4164dd-5266-438d-8db7-5cd6a4e014ef {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:48:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:33 user nova-compute[75288]: INFO nova.compute.manager [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Terminating instance
Nov 10 22:48:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:48:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-91dda7ad-d2e0-4544-a8f4-e29f33c66e14 req-1d682fe6-a2d3-4713-8a2d-58b3f4e8d21e service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91dda7ad-d2e0-4544-a8f4-e29f33c66e14 req-1d682fe6-a2d3-4713-8a2d-58b3f4e8d21e service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91dda7ad-d2e0-4544-a8f4-e29f33c66e14 req-1d682fe6-a2d3-4713-8a2d-58b3f4e8d21e service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91dda7ad-d2e0-4544-a8f4-e29f33c66e14 req-1d682fe6-a2d3-4713-8a2d-58b3f4e8d21e service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-91dda7ad-d2e0-4544-a8f4-e29f33c66e14 req-1d682fe6-a2d3-4713-8a2d-58b3f4e8d21e service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-91dda7ad-d2e0-4544-a8f4-e29f33c66e14 req-1d682fe6-a2d3-4713-8a2d-58b3f4e8d21e service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-unplugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Instance destroyed successfully.
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'resources' on Instance uuid 7b99fd44-d683-43c8-9de4-1cc73e15cc9f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:34 user nova-compute[75288]: INFO nova.compute.manager [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Terminating instance
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-827809454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-827809454',id=20,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-1otxj820',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:46:50Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=7b99fd44-d683-43c8-9de4-1cc73e15cc9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "address": "fa:16:3e:ef:23:84", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5dd02b7-0e", "ovs_interfaceid": "a5dd02b7-0e66-4753-adbc-5ac057ce4fad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_vif [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5dd02b7-0e, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7a720a6-b294-4ee2-8ea8-6811fad2dd11) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: INFO os_vif [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:23:84,bridge_name='br-int',has_traffic_filtering=True,id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5dd02b7-0e')
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] During wait destroy, instance disappeared. {{(pid=75288) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 10 22:48:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance destroyed successfully.
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lazy-loading 'resources' on Instance uuid b9342997-048d-4f4f-a552-de76f2a0a444 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMIyhDRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:34 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1763701259',display_name='tempest-ServerActionsTestOtherB-server-1763701259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1763701259',id=16,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuF/yviImHglYGIXiLmfbAvxX1/9/n49hx51CEU4vPIIK0cwYCFjIHSOmrYvu7mdk8fQPm8oJwZeKNCXTTt3FJg6Tq2wup2YgajWX6dwhMXP1Xwfv2hMNZnvwgRC226mA==',key_name='tempest-keypair-37753185',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='224fa7e9054147d4aa63826efaa17392',ramdisk_id='',reservation_id='r-hxndv4eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-594854393',owner_user_name='tempest-ServerActionsTestOtherB-594854393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18c5517f32c04ad498f307b9b89c6a45',uuid=b9342997-048d-4f4f-a552-de76f2a0a444,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converting VIF {"id": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "address": "fa:16:3e:4f:a7:85", "network": {"id": "f9f63f4c-a33c-4037-a3f2-5c6128fdc448", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1367405680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "224fa7e9054147d4aa63826efaa17392", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap909c66a6-f3", "ovs_interfaceid": "909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_vif [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap909c66a6-f3, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fe247c-62a6-4ddb-a4ab-7073a62ff724]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:34 user nova-compute[75288]: INFO os_vif [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:a7:85,bridge_name='br-int',has_traffic_filtering=True,id=909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83,network=Network(f9f63f4c-a33c-4037-a3f2-5c6128fdc448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap909c66a6-f3')
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:48:34 user nova-compute[75288]: No targets found.
Nov 10 22:48:34 user nova-compute[75288]: iSNS:
Nov 10 22:48:34 user nova-compute[75288]: No targets found.
Nov 10 22:48:34 user nova-compute[75288]: STATIC:
Nov 10 22:48:34 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda
Nov 10 22:48:34 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:48:34 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:48:34 user nova-compute[75288]: FIRMWARE:
Nov 10 22:48:34 user nova-compute[75288]: No targets found.
Nov 10 22:48:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:48:34 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:48:34 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:4f3faf58-a34d-4eb7-b3cc-8ecd91584420', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBxmJSRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:34 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8402c6-3356-4734-80b2-0509505588f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d554c779-578c-43f4-a8bd-c57ac6369899]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:48:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda (non-flash)
Nov 10 22:48:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b202fb2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f6073e-5e43-484d-882a-848a8ffe7155]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[573807ba-bd50-42fc-8919-87bb42355700]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fea1f2-4247-4a39-b728-c0e7131fbcf3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ac1e88-07e1-4405-be40-22007b8de546]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO892692cb-8a7c35d1c732c01c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_892692cb', '/dev/disk/by-id/scsi-23861376333356431') {{(pid=86709) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f5bbc-74aa-40a9-970c-c4dc5e525a93]: (4, None) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05e4829-2c12-4d4d-a860-ebbb7dcf67dc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f1e75-9695-4106-b341-bea11a83c8bb]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260]
Nov 10 22:48:35 user nova-compute[75288]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda, portal: 172.16.0.220,3260] successful.
Nov 10 22:48:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dae92f4-19fc-4363-8255-72bb93d68bda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9d8ec-625e-457c-b4d2-0391718b7086]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] <== disconnect_volume: return (377ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:48:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Deleting instance files /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f_del
Nov 10 22:48:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Deletion of /opt/stack/data/nova/instances/7b99fd44-d683-43c8-9de4-1cc73e15cc9f_del complete
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.340s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5114f59a-fdfe-4dfd-8c11-8264b95a4b54]: Unexpected error while running command.
Nov 10 22:48:35 user nova-compute[75288]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 22:48:35 user nova-compute[75288]: Exit code: 21
Nov 10 22:48:35 user nova-compute[75288]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 22:48:35 user nova-compute[75288]: Stderr: '' {{(pid=86709) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 10 22:48:35 user nova-compute[75288]: Traceback (most recent call last):
Nov 10 22:48:35 user nova-compute[75288]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 10 22:48:35 user nova-compute[75288]:     ret = func(*f_args, **f_kwargs)
Nov 10 22:48:35 user nova-compute[75288]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 10 22:48:35 user nova-compute[75288]:     return func(*args, **kwargs)
Nov 10 22:48:35 user nova-compute[75288]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 10 22:48:35 user nova-compute[75288]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 10 22:48:35 user nova-compute[75288]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 10 22:48:35 user nova-compute[75288]:     return putils.execute(on_execute=on_execute,
Nov 10 22:48:35 user nova-compute[75288]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 10 22:48:35 user nova-compute[75288]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 10 22:48:35 user nova-compute[75288]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 22:48:35 user nova-compute[75288]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 22:48:35 user nova-compute[75288]: Exit code: 21
Nov 10 22:48:35 user nova-compute[75288]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 22:48:35 user nova-compute[75288]: Stderr: ''
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5114f59a-fdfe-4dfd-8c11-8264b95a4b54]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 22:48:35 user nova-compute[75288]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 22:48:35 user nova-compute[75288]: Exit code: 21
Nov 10 22:48:35 user nova-compute[75288]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 22:48:35 user nova-compute[75288]: Stderr: ''
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 10 22:48:35 user nova-compute[75288]: ERROR os_brick.initiator.connectors.iscsi 
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75288) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] <== disconnect_volume: return (418ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:48:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Deletion of /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize failed
Nov 10 22:48:35 user nova-compute[75288]: INFO nova.compute.manager [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:48:35 user nova-compute[75288]: INFO nova.compute.manager [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Took 0.59 seconds to destroy the instance on the hypervisor.
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-db5024b3-0a0d-4b8b-a9bb-dc3739e8171f req-e29a09f5-f78f-429e-bc85-a476aee512d9 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-deleted-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:35 user nova-compute[75288]: INFO nova.compute.manager [req-db5024b3-0a0d-4b8b-a9bb-dc3739e8171f req-e29a09f5-f78f-429e-bc85-a476aee512d9 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Neutron deleted interface a5dd02b7-0e66-4753-adbc-5ac057ce4fad; detaching it from the instance and deleting it from the info cache
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-db5024b3-0a0d-4b8b-a9bb-dc3739e8171f req-e29a09f5-f78f-429e-bc85-a476aee512d9 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:35 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Took 0.70 seconds to deallocate network for instance.
Nov 10 22:48:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-db5024b3-0a0d-4b8b-a9bb-dc3739e8171f req-e29a09f5-f78f-429e-bc85-a476aee512d9 service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Detach interface failed, port_id=a5dd02b7-0e66-4753-adbc-5ac057ce4fad, reason: Instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:48:36 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:48:36 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Took 0.81 seconds to deallocate network for instance.
Nov 10 22:48:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-721f553f-48a5-4f3e-bbd5-d51b77e46367 req-6e68e834-1aaa-43bf-b3de-0c187eb7e7cc service nova] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Received event network-vif-deleted-909c66a6-f3bc-4c78-b38c-c9c3b8f3eb83 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-568f2115-87ce-461c-a369-784410f32ed3 req-4813d22c-33e2-4e7c-b64c-51c8887c446d service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-568f2115-87ce-461c-a369-784410f32ed3 req-4813d22c-33e2-4e7c-b64c-51c8887c446d service nova] Acquiring lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-568f2115-87ce-461c-a369-784410f32ed3 req-4813d22c-33e2-4e7c-b64c-51c8887c446d service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-568f2115-87ce-461c-a369-784410f32ed3 req-4813d22c-33e2-4e7c-b64c-51c8887c446d service nova] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-568f2115-87ce-461c-a369-784410f32ed3 req-4813d22c-33e2-4e7c-b64c-51c8887c446d service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] No waiting events found dispatching network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:36 user nova-compute[75288]: WARNING nova.compute.manager [req-568f2115-87ce-461c-a369-784410f32ed3 req-4813d22c-33e2-4e7c-b64c-51c8887c446d service nova] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Received unexpected event network-vif-plugged-a5dd02b7-0e66-4753-adbc-5ac057ce4fad for instance with vm_state active and task_state deleting.
Nov 10 22:48:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:48:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:40 user nova-compute[75288]: INFO nova.compute.manager [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 7b99fd44-d683-43c8-9de4-1cc73e15cc9f] Took 4.87 seconds to detach 1 volumes for instance.
Nov 10 22:48:40 user nova-compute[75288]: INFO nova.compute.manager [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Took 4.76 seconds to detach 1 volumes for instance.
Nov 10 22:48:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Starting finish_migration {{(pid=75288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 22:48:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Creating image(s)
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Ensure instance console log exists: /opt/stack/data/nova/instances/b1a7d533-cad6-4360-b6c4-f12c6fc473a8/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Start _get_guest_xml network_info=[{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-215817591-network", "vif_mac": "fa:16:3e:f8:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b1a7d533-cad6-4360-b6c4-f12c6fc473a8', 'attached_at': '2023-11-10T22:48:40.000000', 'detached_at': '', 'volume_id': '6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'serial': '6a82a0b8-c74b-4bf1-909a-6350439bb7ef'}, 'mount_device': '/dev/vda', 'attachment_id': '881d41ba-49b0-4540-b546-85340f7cccef', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:48:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:48:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:48:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:48:41 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe553a8c-c339-4249-8471-7ae960db7868]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:48:41 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3b1835-1551-4afc-8f90-f502b4295850]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef] added
Nov 10 22:48:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1b1e4-9db6-42b7-abb5-0caa0a6abdc9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[432d4fe2-d3e6-4be3-aac7-e690f7396c08]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDOdRbeI {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDOdRbeI" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caac112-5295-410d-8f02-c9cda2074a68]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDOdRbeI'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5a1ddc-f5b0-4861-bf6c-65642498cf8b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f954eb5-9743-432e-a5b0-9552bb045300]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 22:48:41 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 22:48:41 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:48:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 22:48:41 user nova-compute[75288]: 
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7166589e-3c38-4ca4-84ad-202af98f4158]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]
Nov 10 22:48:41 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.
Nov 10 22:48:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb421e-fb31-4e3b-ac18-89158692d9b7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d53111-b0aa-4b4d-95b3-eb9423b4ab59]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e4552-2008-43fc-b5aa-df3837042a66]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.469s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:48:41 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Deleted allocations for instance 7b99fd44-d683-43c8-9de4-1cc73e15cc9f
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0ef2537-b95b-43da-840c-717693ae88f5 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "7b99fd44-d683-43c8-9de4-1cc73e15cc9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.704s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:48:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:41 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Deleted allocations for instance b9342997-048d-4f4f-a552-de76f2a0a444
Nov 10 22:48:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a139cfff-9735-4de1-b92e-5fea21a10fd0 tempest-ServerActionsTestOtherB-594854393 tempest-ServerActionsTestOtherB-594854393-project-member] Lock "b9342997-048d-4f4f-a552-de76f2a0a444" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.320s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23066333163363535', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066333163363535', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1858541466',display_name='tempest-ServerActionsTestOtherA-server-1858541466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1858541466',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ez96icqz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=b1a7d533-cad6-4360-b6c4-f12c6fc473a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-215817591-network", "vif_mac": "fa:16:3e:f8:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-215817591-network", "vif_mac": "fa:16:3e:f8:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:48:42 user nova-compute[75288]:   <uuid>b1a7d533-cad6-4360-b6c4-f12c6fc473a8</uuid>
Nov 10 22:48:42 user nova-compute[75288]:   <name>instance-0000001a</name>
Nov 10 22:48:42 user nova-compute[75288]:   <memory>2097152</memory>
Nov 10 22:48:42 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:48:42 user nova-compute[75288]:   <metadata>
Nov 10 22:48:42 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:48:42 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:48:42 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-1858541466</nova:name>
Nov 10 22:48:42 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:48:41</nova:creationTime>
Nov 10 22:48:42 user nova-compute[75288]:       <nova:flavor name="m1.small">
Nov 10 22:48:42 user nova-compute[75288]:         <nova:memory>2048</nova:memory>
Nov 10 22:48:42 user nova-compute[75288]:         <nova:disk>20</nova:disk>
Nov 10 22:48:42 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:48:42 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:48:42 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:48:42 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:48:42 user nova-compute[75288]:       <nova:owner>
Nov 10 22:48:42 user nova-compute[75288]:         <nova:user uuid="1839c7b8368947ccacf91af8fd6f0faf">tempest-ServerActionsTestOtherA-1568173136-project-member</nova:user>
Nov 10 22:48:42 user nova-compute[75288]:         <nova:project uuid="d01027aba7e1424390b507afbad93f23">tempest-ServerActionsTestOtherA-1568173136</nova:project>
Nov 10 22:48:42 user nova-compute[75288]:       </nova:owner>
Nov 10 22:48:42 user nova-compute[75288]:       <nova:ports>
Nov 10 22:48:42 user nova-compute[75288]:         <nova:port uuid="16999ac2-b068-479b-a705-8342b29addc7">
Nov 10 22:48:42 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 22:48:42 user nova-compute[75288]:         </nova:port>
Nov 10 22:48:42 user nova-compute[75288]:       </nova:ports>
Nov 10 22:48:42 user nova-compute[75288]:     </nova:instance>
Nov 10 22:48:42 user nova-compute[75288]:   </metadata>
Nov 10 22:48:42 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:48:42 user nova-compute[75288]:     <system>
Nov 10 22:48:42 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:48:42 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:48:42 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:48:42 user nova-compute[75288]:       <entry name="serial">b1a7d533-cad6-4360-b6c4-f12c6fc473a8</entry>
Nov 10 22:48:42 user nova-compute[75288]:       <entry name="uuid">b1a7d533-cad6-4360-b6c4-f12c6fc473a8</entry>
Nov 10 22:48:42 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:48:42 user nova-compute[75288]:     </system>
Nov 10 22:48:42 user nova-compute[75288]:   </sysinfo>
Nov 10 22:48:42 user nova-compute[75288]:   <os>
Nov 10 22:48:42 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:48:42 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:48:42 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:48:42 user nova-compute[75288]:   </os>
Nov 10 22:48:42 user nova-compute[75288]:   <features>
Nov 10 22:48:42 user nova-compute[75288]:     <acpi/>
Nov 10 22:48:42 user nova-compute[75288]:     <apic/>
Nov 10 22:48:42 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:48:42 user nova-compute[75288]:   </features>
Nov 10 22:48:42 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:48:42 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:48:42 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:48:42 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:48:42 user nova-compute[75288]:   </clock>
Nov 10 22:48:42 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:48:42 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:48:42 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:48:42 user nova-compute[75288]:   </cpu>
Nov 10 22:48:42 user nova-compute[75288]:   <devices>
Nov 10 22:48:42 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:48:42 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:48:42 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 22:48:42 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:48:42 user nova-compute[75288]:       <serial>6a82a0b8-c74b-4bf1-909a-6350439bb7ef</serial>
Nov 10 22:48:42 user nova-compute[75288]:     </disk>
Nov 10 22:48:42 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:48:42 user nova-compute[75288]:       <mac address="fa:16:3e:f8:7b:57"/>
Nov 10 22:48:42 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:48:42 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:48:42 user nova-compute[75288]:       <target dev="tap16999ac2-b0"/>
Nov 10 22:48:42 user nova-compute[75288]:     </interface>
Nov 10 22:48:42 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:48:42 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b1a7d533-cad6-4360-b6c4-f12c6fc473a8/console.log" append="off"/>
Nov 10 22:48:42 user nova-compute[75288]:     </serial>
Nov 10 22:48:42 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:48:42 user nova-compute[75288]:     <video>
Nov 10 22:48:42 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:48:42 user nova-compute[75288]:     </video>
Nov 10 22:48:42 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:48:42 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:48:42 user nova-compute[75288]:     </rng>
Nov 10 22:48:42 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:48:42 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:48:42 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:48:42 user nova-compute[75288]:     </memballoon>
Nov 10 22:48:42 user nova-compute[75288]:   </devices>
Nov 10 22:48:42 user nova-compute[75288]: </domain>
Nov 10 22:48:42 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1858541466',display_name='tempest-ServerActionsTestOtherA-server-1858541466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1858541466',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ez96icqz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=b1a7d533-cad6-4360-b6c4-f12c6fc473a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-215817591-network", "vif_mac": "fa:16:3e:f8:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-215817591-network", "vif_mac": "fa:16:3e:f8:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG os_vif [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a517a037-5229-5960-9006-f963efb41e66', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16999ac2-b0, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16999ac2-b0, col_values=(('qos', UUID('1cbb8b11-3719-450b-9bdf-46e61639de0c')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16999ac2-b0, col_values=(('external_ids', {'iface-id': '16999ac2-b068-479b-a705-8342b29addc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:7b:57', 'vm-uuid': 'b1a7d533-cad6-4360-b6c4-f12c6fc473a8'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:42 user nova-compute[75288]: INFO os_vif [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0')
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:48:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] No VIF found with MAC fa:16:3e:f8:7b:57, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:48:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVuUbwfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:48:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:48:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:48:44 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef42ffe-3b38-47a5-8a68-29706e12615d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:48:44 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4e9214-5dc6-4312-b91a-db2af3f8868b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e] added
Nov 10 22:48:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-7dc5129b-3196-4f86-8e7c-3af7343786c8 req-2be9c5d2-7145-44c7-b484-fa1c9ded1c64 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7dc5129b-3196-4f86-8e7c-3af7343786c8 req-2be9c5d2-7145-44c7-b484-fa1c9ded1c64 service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7dc5129b-3196-4f86-8e7c-3af7343786c8 req-2be9c5d2-7145-44c7-b484-fa1c9ded1c64 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7dc5129b-3196-4f86-8e7c-3af7343786c8 req-2be9c5d2-7145-44c7-b484-fa1c9ded1c64 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-7dc5129b-3196-4f86-8e7c-3af7343786c8 req-2be9c5d2-7145-44c7-b484-fa1c9ded1c64 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:44 user nova-compute[75288]: WARNING nova.compute.manager [req-7dc5129b-3196-4f86-8e7c-3af7343786c8 req-2be9c5d2-7145-44c7-b484-fa1c9ded1c64 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received unexpected event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with vm_state active and task_state resize_finish.
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eab698-3a4b-4c22-915d-8e18151b5023]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be80d27b-1381-4c19-b423-5a060a9db5eb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVuUbwfT {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVuUbwfT" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee496a-77f8-4ce9-b063-b5c038e2758d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVuUbwfT'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c48404c-ce42-4b90-b3ba-9d55e101db98]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4598bb-31bd-4f6e-8ef7-81e1c5d4a9da]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[17283f75-a790-4df2-99b8-1f81422c0cdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260]
Nov 10 22:48:44 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260] successful.
Nov 10 22:48:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23b544a-1f8a-4c57-aba1-f0660883f9d2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4720645a-1e94-42d0-9914-4214eaa65bb1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:44 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e (non-flash)
Nov 10 22:48:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:48:44 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e (non-flash)
Nov 10 22:48:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.034s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32c5a60-3f63-4607-9e94-3aee3a0d708e]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVuUbwfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26365616533633266', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365616533633266', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:48:45 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:48:45 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:48:45 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:48:45 user nova-compute[75288]:   <serial>a298d0a1-97d8-48d6-bea6-7a92937ea28e</serial>
Nov 10 22:48:45 user nova-compute[75288]: </disk>
Nov 10 22:48:45 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:48:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No VIF found with MAC fa:16:3e:81:41:97, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-859362ea-f8a2-4875-ac01-5d8ada3f0be4 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.966s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-4079203f-0e95-4be9-9961-ca7b7200075b req-9a650c8f-b7be-41ba-a85c-87153a359728 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4079203f-0e95-4be9-9961-ca7b7200075b req-9a650c8f-b7be-41ba-a85c-87153a359728 service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4079203f-0e95-4be9-9961-ca7b7200075b req-9a650c8f-b7be-41ba-a85c-87153a359728 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4079203f-0e95-4be9-9961-ca7b7200075b req-9a650c8f-b7be-41ba-a85c-87153a359728 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-4079203f-0e95-4be9-9961-ca7b7200075b req-9a650c8f-b7be-41ba-a85c-87153a359728 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:48:46 user nova-compute[75288]: WARNING nova.compute.manager [req-4079203f-0e95-4be9-9961-ca7b7200075b req-9a650c8f-b7be-41ba-a85c-87153a359728 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received unexpected event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with vm_state active and task_state resize_finish.
Nov 10 22:48:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance running successfully.
Nov 10 22:48:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Failed to set time: agent not configured {{(pid=75288) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 22:48:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bddae2a5-3387-403c-9ac3-bd0546c272f6 tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] finish_migration finished successfully. {{(pid=75288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 22:48:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:48:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:48:48 user nova-compute[75288]: INFO nova.compute.manager [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Detaching volume a298d0a1-97d8-48d6-bea6-7a92937ea28e
Nov 10 22:48:48 user nova-compute[75288]: INFO nova.virt.block_device [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attempting to driver detach volume a298d0a1-97d8-48d6-bea6-7a92937ea28e from mountpoint /dev/vdb
Nov 10 22:48:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Attempting to detach device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:48:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:48:48 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:48:48 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:48:48 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:48:48 user nova-compute[75288]:   <serial>a298d0a1-97d8-48d6-bea6-7a92937ea28e</serial>
Nov 10 22:48:48 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:48:48 user nova-compute[75288]: </disk>
Nov 10 22:48:48 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:48:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config.
Nov 10 22:48:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:48:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:48:48 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:48:48 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:48:48 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:48:48 user nova-compute[75288]:   <serial>a298d0a1-97d8-48d6-bea6-7a92937ea28e</serial>
Nov 10 22:48:48 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:48:48 user nova-compute[75288]: </disk>
Nov 10 22:48:48 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:48:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:48:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:08 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 is timed out.
Nov 10 22:49:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config.
Nov 10 22:49:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVuUbwfT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:49:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[39129866-49e7-4dca-8032-fce7dec35986]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:49:08 user nova-compute[75288]: No targets found.
Nov 10 22:49:08 user nova-compute[75288]: iSNS:
Nov 10 22:49:08 user nova-compute[75288]: No targets found.
Nov 10 22:49:08 user nova-compute[75288]: STATIC:
Nov 10 22:49:08 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e
Nov 10 22:49:08 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:49:08 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:49:08 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:49:08 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:49:08 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:49:08 user nova-compute[75288]: FIRMWARE:
Nov 10 22:49:08 user nova-compute[75288]: No targets found.
Nov 10 22:49:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:49:08 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:49:08 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff19ad7a-6645-489c-a54a-f1a3d49ff1c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34ace98-e9c3-403f-9f68-4b7c5116f5f9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:49:08 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e (non-flash)
Nov 10 22:49:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:49:08 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e (non-flash)
Nov 10 22:49:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b20116b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3da655-bd93-4652-8fd0-c1a15e511a51]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8d0005-85aa-47d0-8f18-ef94a6926bc7]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f354a7-3285-4bd4-9d96-772024cb98f2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54931f2e-48a3-49ed-8706-3804ff714251]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec0c6a2-d4c2-4d3e-9b10-654e800ed576]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17c141-6188-4fbf-a4ec-8d98297fa781]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260]
Nov 10 22:49:09 user nova-compute[75288]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e, portal: 172.16.0.220,3260] successful.
Nov 10 22:49:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a298d0a1-97d8-48d6-bea6-7a92937ea28e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e31a83c-486f-4212-bd90-b8f3012353e7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== disconnect_volume: return (318ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:49:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:49:10 user nova-compute[75288]: DEBUG nova.objects.instance [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-845fdeea-283f-4d6b-9c2f-897dd02d4424 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.279s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiACBSvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:49:11 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:49:11 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:49:11 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3204d-566e-4459-be1a-f0c0dec8bd1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:49:11 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d18a4-8b65-4c80-bdea-36e743b50953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8] added
Nov 10 22:49:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[935eb715-8747-4c59-9a99-fff843b250fd]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[01caa693-3467-4fd6-81a3-3202d7a97d45]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiACBSvE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiACBSvE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f6e398-60e6-43cf-b4c4-fb94a1985930]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NiACBSvE'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2367b1-3e2f-423e-ab07-45ef4822c5e7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dc7039-b20b-4078-bfa8-f1110f1eca51]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:49:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:49:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[264b23fe-b3b8-4cb2-9439-9ce32d730031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260]
Nov 10 22:49:11 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260] successful.
Nov 10 22:49:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68967ea-a864-4011-a91a-766fe950c233]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfbde61-8e20-4b28-9adb-b1d604bf2abc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:49:11 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:49:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:49:11 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:49:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1bd13a-eea8-49b9-8b26-e03eff7b8a4d]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiACBSvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23930626662393365', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930626662393365', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:49:12 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:49:12 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:49:12 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:49:12 user nova-compute[75288]:   <serial>f641fb9e-0968-47a8-8f67-266211e20da8</serial>
Nov 10 22:49:12 user nova-compute[75288]: </disk>
Nov 10 22:49:12 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:49:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:49:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:49:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No VIF found with MAC fa:16:3e:06:c2:db, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:49:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-467f6dea-cea0-4e4f-9e04-3c554baf8bfa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.688s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:49:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:49:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:49:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:49:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updating instance_info_cache with network_info: [{"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:49:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:49:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:25 user nova-compute[75288]: INFO nova.compute.manager [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Terminating instance
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-46de52ad-21ac-487b-8bcc-519139bb1fa2 req-13767e06-dc24-43b2-969d-a4eb2437c774 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received event network-vif-unplugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46de52ad-21ac-487b-8bcc-519139bb1fa2 req-13767e06-dc24-43b2-969d-a4eb2437c774 service nova] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46de52ad-21ac-487b-8bcc-519139bb1fa2 req-13767e06-dc24-43b2-969d-a4eb2437c774 service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46de52ad-21ac-487b-8bcc-519139bb1fa2 req-13767e06-dc24-43b2-969d-a4eb2437c774 service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-46de52ad-21ac-487b-8bcc-519139bb1fa2 req-13767e06-dc24-43b2-969d-a4eb2437c774 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] No waiting events found dispatching network-vif-unplugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-46de52ad-21ac-487b-8bcc-519139bb1fa2 req-13767e06-dc24-43b2-969d-a4eb2437c774 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received event network-vif-unplugged-6f23a514-be0a-441c-a75d-597d7d48efb1 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Instance destroyed successfully.
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.objects.instance [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'resources' on Instance uuid 9bb377b7-e5a5-480f-9dd9-7d4e650841eb {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1848360599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1848360599',id=15,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:39:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-eetk7v5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:41:07Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=9bb377b7-e5a5-480f-9dd9-7d4e650841eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "6f23a514-be0a-441c-a75d-597d7d48efb1", "address": "fa:16:3e:cf:c7:63", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f23a514-be", "ovs_interfaceid": "6f23a514-be0a-441c-a75d-597d7d48efb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c7:63,bridge_name='br-int',has_traffic_filtering=True,id=6f23a514-be0a-441c-a75d-597d7d48efb1,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f23a514-be') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG os_vif [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c7:63,bridge_name='br-int',has_traffic_filtering=True,id=6f23a514-be0a-441c-a75d-597d7d48efb1,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f23a514-be') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f23a514-be, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc940647-b9d6-43ba-9ada-a4c38bb8ce63) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:49:25 user nova-compute[75288]: INFO os_vif [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c7:63,bridge_name='br-int',has_traffic_filtering=True,id=6f23a514-be0a-441c-a75d-597d7d48efb1,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f23a514-be')
Nov 10 22:49:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Deleting instance files /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb_del
Nov 10 22:49:26 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Deletion of /opt/stack/data/nova/instances/9bb377b7-e5a5-480f-9dd9-7d4e650841eb_del complete
Nov 10 22:49:26 user nova-compute[75288]: INFO nova.compute.manager [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 10 22:49:26 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:49:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-a2b81132-b484-402c-ac11-df6f036b33e5 req-e090b368-ab5b-441a-b4e3-88256b37027c service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received event network-vif-deleted-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:27 user nova-compute[75288]: INFO nova.compute.manager [req-a2b81132-b484-402c-ac11-df6f036b33e5 req-e090b368-ab5b-441a-b4e3-88256b37027c service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Neutron deleted interface 6f23a514-be0a-441c-a75d-597d7d48efb1; detaching it from the instance and deleting it from the info cache
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-a2b81132-b484-402c-ac11-df6f036b33e5 req-e090b368-ab5b-441a-b4e3-88256b37027c service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:49:27 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Took 1.14 seconds to deallocate network for instance.
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-a2b81132-b484-402c-ac11-df6f036b33e5 req-e090b368-ab5b-441a-b4e3-88256b37027c service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Detach interface failed, port_id=6f23a514-be0a-441c-a75d-597d7d48efb1, reason: Instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-5a572f35-ea34-4523-be95-3647a81b0340 req-352f5841-f81f-4f87-b4f8-92b6d0e73d67 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received event network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5a572f35-ea34-4523-be95-3647a81b0340 req-352f5841-f81f-4f87-b4f8-92b6d0e73d67 service nova] Acquiring lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5a572f35-ea34-4523-be95-3647a81b0340 req-352f5841-f81f-4f87-b4f8-92b6d0e73d67 service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5a572f35-ea34-4523-be95-3647a81b0340 req-352f5841-f81f-4f87-b4f8-92b6d0e73d67 service nova] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-5a572f35-ea34-4523-be95-3647a81b0340 req-352f5841-f81f-4f87-b4f8-92b6d0e73d67 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] No waiting events found dispatching network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:27 user nova-compute[75288]: WARNING nova.compute.manager [req-5a572f35-ea34-4523-be95-3647a81b0340 req-352f5841-f81f-4f87-b4f8-92b6d0e73d67 service nova] [instance: 9bb377b7-e5a5-480f-9dd9-7d4e650841eb] Received unexpected event network-vif-plugged-6f23a514-be0a-441c-a75d-597d7d48efb1 for instance with vm_state deleted and task_state None.
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:28 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Deleted allocations for instance 9bb377b7-e5a5-480f-9dd9-7d4e650841eb
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-78ae608a-8aa5-4516-b655-d481fbb704a3 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "9bb377b7-e5a5-480f-9dd9-7d4e650841eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.228s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:49:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:49:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7886MB free_disk=25.204025268554688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Applying migration context for instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 as it has an incoming, in-progress migration 25dbea36-6a51-420a-929c-ae6ea630bef0. Migration status is finished {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 22:49:30 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating resource usage from migration 25dbea36-6a51-420a-929c-ae6ea630bef0
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 032de95e-98a7-411d-8726-5bf3a5c0ca49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 70c0e693-25bf-45bb-80b8-a3829e58a067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Migration 25dbea36-6a51-420a-929c-ae6ea630bef0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:30 user nova-compute[75288]: INFO nova.compute.manager [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Attaching volume c5bc89e7-5136-41f1-8356-5c0326d0dae4 to /dev/vdc
Nov 10 22:49:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d783b212-88cb-4049-aef5-5e483f6a44a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[459b1309-1e13-40db-bb82-cfe7ebb1a425]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4bba44-c244-4ec3-bf6b-ee990f889a4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb132fee-a95f-49c0-8ba0-2cbee78ab762]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:49:30 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[140091c6-e3b1-4882-b1a4-f80d43b17667]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updating existing volume attachment record: 5820e122-54e1-4e1d-9977-778d15f6f5c9 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-changed-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Refreshing instance network info cache due to event network-changed-7ed0c9fb-6897-425d-8c29-ba63bfd452d6. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] Acquiring lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] Acquired lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:49:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Refreshing network info cache for port 7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:33 user nova-compute[75288]: INFO nova.compute.manager [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Terminating instance
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updated VIF entry in instance network info cache for port 7ed0c9fb-6897-425d-8c29-ba63bfd452d6. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updating instance_info_cache with network_info: [{"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c1e3cbd-2cb4-4abd-9cd0-04e9a1b18caf req-db7590c3-1c73-4762-9d9e-5307c841c86f service nova] Releasing lock "refresh_cache-70c0e693-25bf-45bb-80b8-a3829e58a067" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b65737b-b38f-4976-b071-dde9b8d09e2f req-d20a1f39-7bd4-4f53-ae15-df91f61355f0 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-unplugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b65737b-b38f-4976-b071-dde9b8d09e2f req-d20a1f39-7bd4-4f53-ae15-df91f61355f0 service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b65737b-b38f-4976-b071-dde9b8d09e2f req-d20a1f39-7bd4-4f53-ae15-df91f61355f0 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b65737b-b38f-4976-b071-dde9b8d09e2f req-d20a1f39-7bd4-4f53-ae15-df91f61355f0 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b65737b-b38f-4976-b071-dde9b8d09e2f req-d20a1f39-7bd4-4f53-ae15-df91f61355f0 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-unplugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b65737b-b38f-4976-b071-dde9b8d09e2f req-d20a1f39-7bd4-4f53-ae15-df91f61355f0 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-unplugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Instance destroyed successfully.
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.objects.instance [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lazy-loading 'resources' on Instance uuid 70c0e693-25bf-45bb-80b8-a3829e58a067 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-671503018',display_name='tempest-TestStampPattern-server-671503018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-671503018',id=18,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhOyHQ/mMcppCwCJUcBtZB9RAsC8DcDZYbZel44qDgENac/guD67yMkwHCAMOuJ/b/WnIA9XMdWVs2PHqnRCV/vU+mu+EYcKal9GrSkHUYouqZemEhNE4qY9vOyDF7nA==',key_name='tempest-TestStampPattern-1399113466',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f2f4e0a73b542a8a78c748a4d1c5914',ramdisk_id='',reservation_id='r-2bhrdarm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2137207160',owner_user_name='tempest-TestStampPattern-2137207160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:44:51Z,user_data=None,user_id='824744a11e9d4e4d9095fb0558632e00',uuid=70c0e693-25bf-45bb-80b8-a3829e58a067,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converting VIF {"id": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "address": "fa:16:3e:bc:39:04", "network": {"id": "d32ef519-89e9-472a-8c51-ffabea064865", "bridge": "br-int", "label": "tempest-TestStampPattern-2085739741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2f4e0a73b542a8a78c748a4d1c5914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0c9fb-68", "ovs_interfaceid": "7ed0c9fb-6897-425d-8c29-ba63bfd452d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:39:04,bridge_name='br-int',has_traffic_filtering=True,id=7ed0c9fb-6897-425d-8c29-ba63bfd452d6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0c9fb-68') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG os_vif [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:39:04,bridge_name='br-int',has_traffic_filtering=True,id=7ed0c9fb-6897-425d-8c29-ba63bfd452d6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0c9fb-68') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ed0c9fb-68, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=518b221e-b2b6-4cb9-befe-848b72e73472) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: INFO os_vif [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:39:04,bridge_name='br-int',has_traffic_filtering=True,id=7ed0c9fb-6897-425d-8c29-ba63bfd452d6,network=Network(d32ef519-89e9-472a-8c51-ffabea064865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0c9fb-68')
Nov 10 22:49:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Deleting instance files /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067_del
Nov 10 22:49:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Deletion of /opt/stack/data/nova/instances/70c0e693-25bf-45bb-80b8-a3829e58a067_del complete
Nov 10 22:49:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:33 user nova-compute[75288]: INFO nova.compute.manager [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 22:49:33 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:49:33 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:49:34 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Took 0.66 seconds to deallocate network for instance.
Nov 10 22:49:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-60393549-9146-4ea7-a565-9d09b38426ed req-1286e0a1-ca84-4a0d-8005-b502caa58ded service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-deleted-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:49:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:35 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Deleted allocations for instance 70c0e693-25bf-45bb-80b8-a3829e58a067
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-46cc0d98-64ae-4616-9779-d85fce3ed4a9 tempest-TestStampPattern-2137207160 tempest-TestStampPattern-2137207160-project-member] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:35 user nova-compute[75288]: WARNING nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received unexpected event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with vm_state deleted and task_state None.
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:35 user nova-compute[75288]: WARNING nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received unexpected event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with vm_state deleted and task_state None.
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:35 user nova-compute[75288]: WARNING nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received unexpected event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with vm_state deleted and task_state None.
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-unplugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-unplugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:35 user nova-compute[75288]: WARNING nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received unexpected event network-vif-unplugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with vm_state deleted and task_state None.
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Acquiring lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] Lock "70c0e693-25bf-45bb-80b8-a3829e58a067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] No waiting events found dispatching network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:49:35 user nova-compute[75288]: WARNING nova.compute.manager [req-5c95bc9b-d7db-4711-843f-4746561c089c req-3f506e41-6035-479a-9053-e3ec1ca0bf24 service nova] [instance: 70c0e693-25bf-45bb-80b8-a3829e58a067] Received unexpected event network-vif-plugged-7ed0c9fb-6897-425d-8c29-ba63bfd452d6 for instance with vm_state deleted and task_state None.
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:49:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:49:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:49:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:49:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:49:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:49:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:46 user nova-compute[75288]: INFO nova.compute.manager [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attaching volume 984c8acb-8712-4206-b216-70f69a783157 to /dev/vdb
Nov 10 22:49:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba7d843-088a-457f-803d-99cff8c82bf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfa0bfb-3fad-4a91-8a55-3fc65147c69c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[129d3cb1-3c93-4fd6-8b4d-ac3daa2227a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbee08f-c6aa-45a8-abb1-b52d4556b529]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:49:46 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:49:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98a8496-cc27-44d8-a983-3b6972c3b43f]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:49:46 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating existing volume attachment record: c1eb4b62-b9e2-48c7-85b5-32c0ac26998b {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:49:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:49:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:49:56 user nova-compute[75288]: INFO nova.compute.claims [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Claim successful on node user
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:49:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:49:57 user nova-compute[75288]: INFO nova.compute.claims [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Claim successful on node user
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.policy [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa64d78d0ed47e9af81121ea1e9e34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8bee5841243ecbc00a012f27016fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:49:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Creating image(s)
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk 1073741824" returned: 0 in 0.084s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Going to confirm migration 2 {{(pid=75288) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.policy [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa64d78d0ed47e9af81121ea1e9e34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8bee5841243ecbc00a012f27016fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Successfully created port: a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:49:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Creating image(s)
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Cannot resize image /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Ensure instance console log exists: /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquired lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'info_cache' on Instance uuid b1a7d533-cad6-4360-b6c4-f12c6fc473a8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk 1073741824" returned: 0 in 0.077s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Successfully created port: 3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.244s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating instance_info_cache with network_info: [{"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Cannot resize image /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Ensure instance console log exists: /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Releasing lock "refresh_cache-b1a7d533-cad6-4360-b6c4-f12c6fc473a8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'migration_context' on Instance uuid b1a7d533-cad6-4360-b6c4-f12c6fc473a8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.objects.base [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Object Instance<b1a7d533-cad6-4360-b6c4-f12c6fc473a8> lazy-loaded attributes: info_cache,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Successfully updated port: a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-changed-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Refreshing instance network info cache due to event network-changed-a23e0df0-18b8-4950-9f59-5150861a4c28. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:49:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Successfully updated port: 3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance network_info: |[{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Refreshing network info cache for port a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Start _get_guest_xml network_info=[{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-changed-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Refreshing instance network info cache due to event network-changed-3b62047c-54d3-41ba-a037-230d76298105. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] Acquiring lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:50:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.578s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449796295',display_name='tempest-ServerRescueNegativeTestJSON-server-449796295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-449796295',id=28,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-jfvj441o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:49:58Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=0c73ba31-10a8-483a-9fcc-fe0beeeffba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:50:00 user nova-compute[75288]:   <uuid>0c73ba31-10a8-483a-9fcc-fe0beeeffba8</uuid>
Nov 10 22:50:00 user nova-compute[75288]:   <name>instance-0000001c</name>
Nov 10 22:50:00 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:50:00 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:50:00 user nova-compute[75288]:   <metadata>
Nov 10 22:50:00 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:50:00 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-449796295</nova:name>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:50:00</nova:creationTime>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:50:00 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:50:00 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:owner>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:user uuid="8aa64d78d0ed47e9af81121ea1e9e34a">tempest-ServerRescueNegativeTestJSON-423881024-project-member</nova:user>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:project uuid="0fb8bee5841243ecbc00a012f27016fe">tempest-ServerRescueNegativeTestJSON-423881024</nova:project>
Nov 10 22:50:00 user nova-compute[75288]:       </nova:owner>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:ports>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:port uuid="a23e0df0-18b8-4950-9f59-5150861a4c28">
Nov 10 22:50:00 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:50:00 user nova-compute[75288]:         </nova:port>
Nov 10 22:50:00 user nova-compute[75288]:       </nova:ports>
Nov 10 22:50:00 user nova-compute[75288]:     </nova:instance>
Nov 10 22:50:00 user nova-compute[75288]:   </metadata>
Nov 10 22:50:00 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:50:00 user nova-compute[75288]:     <system>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="serial">0c73ba31-10a8-483a-9fcc-fe0beeeffba8</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="uuid">0c73ba31-10a8-483a-9fcc-fe0beeeffba8</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:50:00 user nova-compute[75288]:     </system>
Nov 10 22:50:00 user nova-compute[75288]:   </sysinfo>
Nov 10 22:50:00 user nova-compute[75288]:   <os>
Nov 10 22:50:00 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:50:00 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:50:00 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:50:00 user nova-compute[75288]:   </os>
Nov 10 22:50:00 user nova-compute[75288]:   <features>
Nov 10 22:50:00 user nova-compute[75288]:     <acpi/>
Nov 10 22:50:00 user nova-compute[75288]:     <apic/>
Nov 10 22:50:00 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:50:00 user nova-compute[75288]:   </features>
Nov 10 22:50:00 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:50:00 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:50:00 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:50:00 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:50:00 user nova-compute[75288]:   </clock>
Nov 10 22:50:00 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:50:00 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:50:00 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:50:00 user nova-compute[75288]:   </cpu>
Nov 10 22:50:00 user nova-compute[75288]:   <devices>
Nov 10 22:50:00 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:50:00 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:50:00 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk"/>
Nov 10 22:50:00 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:50:00 user nova-compute[75288]:     </disk>
Nov 10 22:50:00 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:50:00 user nova-compute[75288]:       <mac address="fa:16:3e:04:76:81"/>
Nov 10 22:50:00 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:50:00 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:50:00 user nova-compute[75288]:       <target dev="tapa23e0df0-18"/>
Nov 10 22:50:00 user nova-compute[75288]:     </interface>
Nov 10 22:50:00 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:50:00 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/console.log" append="off"/>
Nov 10 22:50:00 user nova-compute[75288]:     </serial>
Nov 10 22:50:00 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:50:00 user nova-compute[75288]:     <video>
Nov 10 22:50:00 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:50:00 user nova-compute[75288]:     </video>
Nov 10 22:50:00 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:50:00 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:50:00 user nova-compute[75288]:     </rng>
Nov 10 22:50:00 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:50:00 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:50:00 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:50:00 user nova-compute[75288]:     </memballoon>
Nov 10 22:50:00 user nova-compute[75288]:   </devices>
Nov 10 22:50:00 user nova-compute[75288]: </domain>
Nov 10 22:50:00 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449796295',display_name='tempest-ServerRescueNegativeTestJSON-server-449796295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-449796295',id=28,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-jfvj441o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:49:58Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=0c73ba31-10a8-483a-9fcc-fe0beeeffba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG os_vif [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aad68730-3866-5332-92d2-931d9d0c0af9', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa23e0df0-18, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa23e0df0-18, col_values=(('qos', UUID('976d958f-cc38-4e0b-8e13-f8dc6df8cbec')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa23e0df0-18, col_values=(('external_ids', {'iface-id': 'a23e0df0-18b8-4950-9f59-5150861a4c28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:76:81', 'vm-uuid': '0c73ba31-10a8-483a-9fcc-fe0beeeffba8'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: INFO os_vif [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18')
Nov 10 22:50:00 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Deleted allocation for migration 25dbea36-6a51-420a-929c-ae6ea630bef0
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No VIF found with MAC fa:16:3e:04:76:81, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updating instance_info_cache with network_info: [{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance network_info: |[{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] Acquired lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Refreshing network info cache for port 3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Start _get_guest_xml network_info=[{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1629b103-06a6-4625-ac80-6b417db83b7e tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.103s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-888792900',display_name='tempest-ServerRescueNegativeTestJSON-server-888792900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-888792900',id=29,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-nim7tncv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:49:59Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=ad132b9c-5de3-4d1a-ab55-4e95d589df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'pci_devices' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:50:00 user nova-compute[75288]:   <uuid>ad132b9c-5de3-4d1a-ab55-4e95d589df45</uuid>
Nov 10 22:50:00 user nova-compute[75288]:   <name>instance-0000001d</name>
Nov 10 22:50:00 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:50:00 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:50:00 user nova-compute[75288]:   <metadata>
Nov 10 22:50:00 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:50:00 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-888792900</nova:name>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:50:00</nova:creationTime>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:50:00 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:50:00 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:owner>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:user uuid="8aa64d78d0ed47e9af81121ea1e9e34a">tempest-ServerRescueNegativeTestJSON-423881024-project-member</nova:user>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:project uuid="0fb8bee5841243ecbc00a012f27016fe">tempest-ServerRescueNegativeTestJSON-423881024</nova:project>
Nov 10 22:50:00 user nova-compute[75288]:       </nova:owner>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:50:00 user nova-compute[75288]:       <nova:ports>
Nov 10 22:50:00 user nova-compute[75288]:         <nova:port uuid="3b62047c-54d3-41ba-a037-230d76298105">
Nov 10 22:50:00 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 22:50:00 user nova-compute[75288]:         </nova:port>
Nov 10 22:50:00 user nova-compute[75288]:       </nova:ports>
Nov 10 22:50:00 user nova-compute[75288]:     </nova:instance>
Nov 10 22:50:00 user nova-compute[75288]:   </metadata>
Nov 10 22:50:00 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:50:00 user nova-compute[75288]:     <system>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="serial">ad132b9c-5de3-4d1a-ab55-4e95d589df45</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="uuid">ad132b9c-5de3-4d1a-ab55-4e95d589df45</entry>
Nov 10 22:50:00 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:50:00 user nova-compute[75288]:     </system>
Nov 10 22:50:00 user nova-compute[75288]:   </sysinfo>
Nov 10 22:50:00 user nova-compute[75288]:   <os>
Nov 10 22:50:00 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:50:00 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:50:00 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:50:00 user nova-compute[75288]:   </os>
Nov 10 22:50:00 user nova-compute[75288]:   <features>
Nov 10 22:50:00 user nova-compute[75288]:     <acpi/>
Nov 10 22:50:00 user nova-compute[75288]:     <apic/>
Nov 10 22:50:00 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:50:00 user nova-compute[75288]:   </features>
Nov 10 22:50:00 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:50:00 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:50:00 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:50:00 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:50:00 user nova-compute[75288]:   </clock>
Nov 10 22:50:00 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:50:00 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:50:00 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:50:00 user nova-compute[75288]:   </cpu>
Nov 10 22:50:00 user nova-compute[75288]:   <devices>
Nov 10 22:50:00 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:50:00 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:50:00 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk"/>
Nov 10 22:50:00 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:50:00 user nova-compute[75288]:     </disk>
Nov 10 22:50:00 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:50:00 user nova-compute[75288]:       <mac address="fa:16:3e:2c:74:f2"/>
Nov 10 22:50:00 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:50:00 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:50:00 user nova-compute[75288]:       <target dev="tap3b62047c-54"/>
Nov 10 22:50:00 user nova-compute[75288]:     </interface>
Nov 10 22:50:00 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:50:00 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/console.log" append="off"/>
Nov 10 22:50:00 user nova-compute[75288]:     </serial>
Nov 10 22:50:00 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:50:00 user nova-compute[75288]:     <video>
Nov 10 22:50:00 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:50:00 user nova-compute[75288]:     </video>
Nov 10 22:50:00 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:50:00 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:50:00 user nova-compute[75288]:     </rng>
Nov 10 22:50:00 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:50:00 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:50:00 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:50:00 user nova-compute[75288]:     </memballoon>
Nov 10 22:50:00 user nova-compute[75288]:   </devices>
Nov 10 22:50:00 user nova-compute[75288]: </domain>
Nov 10 22:50:00 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-888792900',display_name='tempest-ServerRescueNegativeTestJSON-server-888792900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-888792900',id=29,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-nim7tncv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:49:59Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=ad132b9c-5de3-4d1a-ab55-4e95d589df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG os_vif [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6034416a-4725-5e2d-9551-c066eb5cc243', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b62047c-54, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b62047c-54, col_values=(('qos', UUID('467e7a2e-60f3-4c38-837f-6d93d372df0c')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b62047c-54, col_values=(('external_ids', {'iface-id': '3b62047c-54d3-41ba-a037-230d76298105', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:74:f2', 'vm-uuid': 'ad132b9c-5de3-4d1a-ab55-4e95d589df45'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:00 user nova-compute[75288]: INFO os_vif [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54')
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No VIF found with MAC fa:16:3e:2c:74:f2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updated VIF entry in instance network info cache for port a23e0df0-18b8-4950-9f59-5150861a4c28. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5a9e6b7d-59b1-4e05-b12a-39492bed4408 req-038890bc-8e39-4cda-8b61-427e87170d76 service nova] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:50:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updated VIF entry in instance network info cache for port 3b62047c-54d3-41ba-a037-230d76298105. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:50:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updating instance_info_cache with network_info: [{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e4c7110-b162-4cda-b9de-c8b517c910eb req-03982af7-56ac-4678-8aeb-04e613b719c9 service nova] Releasing lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-52fdfd0c-7015-490e-890a-1f68af91c91f req-5ea08680-262a-40cc-b949-b6d6939f17e6 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-52fdfd0c-7015-490e-890a-1f68af91c91f req-5ea08680-262a-40cc-b949-b6d6939f17e6 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-52fdfd0c-7015-490e-890a-1f68af91c91f req-5ea08680-262a-40cc-b949-b6d6939f17e6 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-52fdfd0c-7015-490e-890a-1f68af91c91f req-5ea08680-262a-40cc-b949-b6d6939f17e6 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-52fdfd0c-7015-490e-890a-1f68af91c91f req-5ea08680-262a-40cc-b949-b6d6939f17e6 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:03 user nova-compute[75288]: WARNING nova.compute.manager [req-52fdfd0c-7015-490e-890a-1f68af91c91f req-5ea08680-262a-40cc-b949-b6d6939f17e6 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state building and task_state spawning.
Nov 10 22:50:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-4fc42113-c301-45eb-b9a4-8689d79cbf1c req-92065497-9d10-4f55-a8e0-48a6424b3b97 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4fc42113-c301-45eb-b9a4-8689d79cbf1c req-92065497-9d10-4f55-a8e0-48a6424b3b97 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4fc42113-c301-45eb-b9a4-8689d79cbf1c req-92065497-9d10-4f55-a8e0-48a6424b3b97 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4fc42113-c301-45eb-b9a4-8689d79cbf1c req-92065497-9d10-4f55-a8e0-48a6424b3b97 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-4fc42113-c301-45eb-b9a4-8689d79cbf1c req-92065497-9d10-4f55-a8e0-48a6424b3b97 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:03 user nova-compute[75288]: WARNING nova.compute.manager [req-4fc42113-c301-45eb-b9a4-8689d79cbf1c req-92065497-9d10-4f55-a8e0-48a6424b3b97 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received unexpected event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with vm_state building and task_state spawning.
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-cdadd24f-c168-4697-8fea-04c017447836 req-692289d2-11f1-4004-835d-bbc23ab470ac service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cdadd24f-c168-4697-8fea-04c017447836 req-692289d2-11f1-4004-835d-bbc23ab470ac service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cdadd24f-c168-4697-8fea-04c017447836 req-692289d2-11f1-4004-835d-bbc23ab470ac service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cdadd24f-c168-4697-8fea-04c017447836 req-692289d2-11f1-4004-835d-bbc23ab470ac service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-cdadd24f-c168-4697-8fea-04c017447836 req-692289d2-11f1-4004-835d-bbc23ab470ac service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:05 user nova-compute[75288]: WARNING nova.compute.manager [req-cdadd24f-c168-4697-8fea-04c017447836 req-692289d2-11f1-4004-835d-bbc23ab470ac service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state building and task_state spawning.
Nov 10 22:50:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-af05ee5b-b42a-4ed1-b4e7-87b1c685f89f req-7b9fcecc-a60e-41ef-9208-973038e40574 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af05ee5b-b42a-4ed1-b4e7-87b1c685f89f req-7b9fcecc-a60e-41ef-9208-973038e40574 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af05ee5b-b42a-4ed1-b4e7-87b1c685f89f req-7b9fcecc-a60e-41ef-9208-973038e40574 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af05ee5b-b42a-4ed1-b4e7-87b1c685f89f req-7b9fcecc-a60e-41ef-9208-973038e40574 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-af05ee5b-b42a-4ed1-b4e7-87b1c685f89f req-7b9fcecc-a60e-41ef-9208-973038e40574 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:05 user nova-compute[75288]: WARNING nova.compute.manager [req-af05ee5b-b42a-4ed1-b4e7-87b1c685f89f req-7b9fcecc-a60e-41ef-9208-973038e40574 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received unexpected event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with vm_state building and task_state spawning.
Nov 10 22:50:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:50:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance spawned successfully.
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:50:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance spawned successfully.
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:06 user nova-compute[75288]: INFO nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Took 8.03 seconds to spawn the instance on the hypervisor.
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:50:06 user nova-compute[75288]: INFO nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Took 9.00 seconds to spawn the instance on the hypervisor.
Nov 10 22:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:50:06 user nova-compute[75288]: INFO nova.compute.manager [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Took 10.11 seconds to build instance.
Nov 10 22:50:06 user nova-compute[75288]: INFO nova.compute.manager [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Took 9.26 seconds to build instance.
Nov 10 22:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d38616c5-3127-4c5a-bef6-13030da9a388 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.228s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe7f3832-18a9-4275-94f4-c3343314b83d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.362s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:07 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:50:07 user nova-compute[75288]: INFO nova.compute.claims [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Claim successful on node user
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.759s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:50:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.policy [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db25e1cfa98c4bdea7c28dd848a81781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa1cd0b367844798543f77845cda352', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:50:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Creating image(s)
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "/opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "/opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk 1073741824" returned: 0 in 0.073s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Successfully created port: 6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.321s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Cannot resize image /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Ensure instance console log exists: /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyNenIjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:50:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:50:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:50:10 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4fae09-b1d8-425e-8018-c536b2a9660d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:50:10 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ae8f04-c412-4159-8260-f2507a43e814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4] added
Nov 10 22:50:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[68303041-23f9-41e1-a238-d42aec708f77]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Successfully updated port: 6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a5173f-20d5-4b4c-a5e7-87ffbd4e2351]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyNenIjH {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquired lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyNenIjH" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c99488-1fd1-411a-877b-ded8c025b555]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cyNenIjH'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Received event network-changed-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Refreshing instance network info cache due to event network-changed-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] Acquiring lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e083b58-2e31-40f5-8526-adb2774d3468]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8423eba2-aff5-4ec7-9380-1b290f0d94b3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:10 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:10 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7196f341-1f4f-4761-9e08-72d6230e61ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260]
Nov 10 22:50:10 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260] successful.
Nov 10 22:50:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d58783f-703b-4084-b1a2-b3b46668289f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde32f88-d861-4ef6-8a82-8a71312890f3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:10 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:10 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:10 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:10 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff259af-40df-45ac-a5fa-bde595261ed9]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyNenIjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updating instance_info_cache with network_info: [{"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Releasing lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Instance network_info: |[{"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] Acquired lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Refreshing network info cache for port 6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Start _get_guest_xml network_info=[{"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:10 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:10 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410868930',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410868930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1410868',id=30,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxFFSvYwLciXmQXBa1MZQE2gSHiFbL6PI8/wRUfpu9m8fbMDcl+cf2W1prbmWF0AW8c9wBuqefy4to/iqcgcie5twtE01cEcJjFRYigCqISppuQLAJmHhODfUf/CwJPrA==',key_name='tempest-keypair-1452670727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa1cd0b367844798543f77845cda352',ramdisk_id='',reservation_id='r-a854hlg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-94576300',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db25e1cfa98c4bdea7c28dd848a81781',uuid=0f78309d-5e39-4a65-a375-96f43b4ad21f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Converting VIF {"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f8:a3,bridge_name='br-int',has_traffic_filtering=True,id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720,network=Network(3788b6a8-29e7-4e09-aca9-d9a7560d266a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0d0abf-11') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f78309d-5e39-4a65-a375-96f43b4ad21f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:50:10 user nova-compute[75288]:   <uuid>0f78309d-5e39-4a65-a375-96f43b4ad21f</uuid>
Nov 10 22:50:10 user nova-compute[75288]:   <name>instance-0000001e</name>
Nov 10 22:50:10 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:50:10 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:50:10 user nova-compute[75288]:   <metadata>
Nov 10 22:50:10 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:50:10 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:50:10 user nova-compute[75288]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1410868930</nova:name>
Nov 10 22:50:10 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:50:10</nova:creationTime>
Nov 10 22:50:10 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:50:10 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:50:10 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:50:10 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:50:10 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:50:10 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:50:10 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:50:10 user nova-compute[75288]:       <nova:owner>
Nov 10 22:50:10 user nova-compute[75288]:         <nova:user uuid="db25e1cfa98c4bdea7c28dd848a81781">tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member</nova:user>
Nov 10 22:50:10 user nova-compute[75288]:         <nova:project uuid="8fa1cd0b367844798543f77845cda352">tempest-TestServerVolumeAttachScenarioOldVersion-94576300</nova:project>
Nov 10 22:50:10 user nova-compute[75288]:       </nova:owner>
Nov 10 22:50:10 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:50:10 user nova-compute[75288]:       <nova:ports>
Nov 10 22:50:10 user nova-compute[75288]:         <nova:port uuid="6b0d0abf-11e1-45c0-80f8-8c77f0a3d720">
Nov 10 22:50:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 22:50:10 user nova-compute[75288]:         </nova:port>
Nov 10 22:50:10 user nova-compute[75288]:       </nova:ports>
Nov 10 22:50:10 user nova-compute[75288]:     </nova:instance>
Nov 10 22:50:10 user nova-compute[75288]:   </metadata>
Nov 10 22:50:10 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:50:10 user nova-compute[75288]:     <system>
Nov 10 22:50:10 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:50:10 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:50:10 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:50:10 user nova-compute[75288]:       <entry name="serial">0f78309d-5e39-4a65-a375-96f43b4ad21f</entry>
Nov 10 22:50:10 user nova-compute[75288]:       <entry name="uuid">0f78309d-5e39-4a65-a375-96f43b4ad21f</entry>
Nov 10 22:50:10 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:50:10 user nova-compute[75288]:     </system>
Nov 10 22:50:10 user nova-compute[75288]:   </sysinfo>
Nov 10 22:50:10 user nova-compute[75288]:   <os>
Nov 10 22:50:10 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:50:10 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:50:10 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:50:10 user nova-compute[75288]:   </os>
Nov 10 22:50:10 user nova-compute[75288]:   <features>
Nov 10 22:50:10 user nova-compute[75288]:     <acpi/>
Nov 10 22:50:10 user nova-compute[75288]:     <apic/>
Nov 10 22:50:10 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:50:10 user nova-compute[75288]:   </features>
Nov 10 22:50:10 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:50:10 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:50:10 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:50:10 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:50:10 user nova-compute[75288]:   </clock>
Nov 10 22:50:10 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:50:10 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:50:10 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:50:10 user nova-compute[75288]:   </cpu>
Nov 10 22:50:10 user nova-compute[75288]:   <devices>
Nov 10 22:50:10 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:50:10 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:50:10 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk"/>
Nov 10 22:50:10 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:50:10 user nova-compute[75288]:     </disk>
Nov 10 22:50:10 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:50:10 user nova-compute[75288]:       <mac address="fa:16:3e:c0:f8:a3"/>
Nov 10 22:50:10 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:50:10 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:50:10 user nova-compute[75288]:       <target dev="tap6b0d0abf-11"/>
Nov 10 22:50:10 user nova-compute[75288]:     </interface>
Nov 10 22:50:10 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:50:10 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/console.log" append="off"/>
Nov 10 22:50:10 user nova-compute[75288]:     </serial>
Nov 10 22:50:10 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:50:10 user nova-compute[75288]:     <video>
Nov 10 22:50:10 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:50:10 user nova-compute[75288]:     </video>
Nov 10 22:50:10 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:50:10 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:50:10 user nova-compute[75288]:     </rng>
Nov 10 22:50:10 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:50:10 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:50:10 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:50:10 user nova-compute[75288]:     </memballoon>
Nov 10 22:50:10 user nova-compute[75288]:   </devices>
Nov 10 22:50:10 user nova-compute[75288]: </domain>
Nov 10 22:50:10 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410868930',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410868930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1410868',id=30,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxFFSvYwLciXmQXBa1MZQE2gSHiFbL6PI8/wRUfpu9m8fbMDcl+cf2W1prbmWF0AW8c9wBuqefy4to/iqcgcie5twtE01cEcJjFRYigCqISppuQLAJmHhODfUf/CwJPrA==',key_name='tempest-keypair-1452670727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa1cd0b367844798543f77845cda352',ramdisk_id='',reservation_id='r-a854hlg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-94576300',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db25e1cfa98c4bdea7c28dd848a81781',uuid=0f78309d-5e39-4a65-a375-96f43b4ad21f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Converting VIF {"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f8:a3,bridge_name='br-int',has_traffic_filtering=True,id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720,network=Network(3788b6a8-29e7-4e09-aca9-d9a7560d266a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0d0abf-11') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG os_vif [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f8:a3,bridge_name='br-int',has_traffic_filtering=True,id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720,network=Network(3788b6a8-29e7-4e09-aca9-d9a7560d266a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0d0abf-11') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '152e73f1-feb3-5e52-98ae-10d7b60d9603', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b0d0abf-11, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b0d0abf-11, col_values=(('qos', UUID('c210e774-5582-4901-b5d1-85d08fba362b')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b0d0abf-11, col_values=(('external_ids', {'iface-id': '6b0d0abf-11e1-45c0-80f8-8c77f0a3d720', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:f8:a3', 'vm-uuid': '0f78309d-5e39-4a65-a375-96f43b4ad21f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:10 user nova-compute[75288]: INFO os_vif [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:f8:a3,bridge_name='br-int',has_traffic_filtering=True,id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720,network=Network(3788b6a8-29e7-4e09-aca9-d9a7560d266a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0d0abf-11')
Nov 10 22:50:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] No VIF found with MAC fa:16:3e:c0:f8:a3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updated VIF entry in instance network info cache for port 6b0d0abf-11e1-45c0-80f8-8c77f0a3d720. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updating instance_info_cache with network_info: [{"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-34cffccd-beb4-4b5f-9bc5-b797242a9576 req-ee30400c-2525-45b2-88c6-5b91aae573e1 service nova] Releasing lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23734633332326661', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734633332326661', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:50:11 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:11 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:50:11 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:50:11 user nova-compute[75288]:   <serial>c5bc89e7-5136-41f1-8356-5c0326d0dae4</serial>
Nov 10 22:50:11 user nova-compute[75288]: </disk>
Nov 10 22:50:11 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:50:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] No VIF found with MAC fa:16:3e:06:c2:db, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5a786c1-f241-4247-ae11-230c979d57aa tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.727s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-0569a791-4e7a-42a3-8cfa-196f27866a9c req-f66566b7-557e-40dd-a994-d79cd303795b service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Received event network-vif-plugged-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0569a791-4e7a-42a3-8cfa-196f27866a9c req-f66566b7-557e-40dd-a994-d79cd303795b service nova] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0569a791-4e7a-42a3-8cfa-196f27866a9c req-f66566b7-557e-40dd-a994-d79cd303795b service nova] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0569a791-4e7a-42a3-8cfa-196f27866a9c req-f66566b7-557e-40dd-a994-d79cd303795b service nova] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-0569a791-4e7a-42a3-8cfa-196f27866a9c req-f66566b7-557e-40dd-a994-d79cd303795b service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] No waiting events found dispatching network-vif-plugged-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:13 user nova-compute[75288]: WARNING nova.compute.manager [req-0569a791-4e7a-42a3-8cfa-196f27866a9c req-f66566b7-557e-40dd-a994-d79cd303795b service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Received unexpected event network-vif-plugged-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 for instance with vm_state building and task_state spawning.
Nov 10 22:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:13 user nova-compute[75288]: INFO nova.compute.manager [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Detaching volume f641fb9e-0968-47a8-8f67-266211e20da8
Nov 10 22:50:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:13 user nova-compute[75288]: INFO nova.virt.block_device [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Attempting to driver detach volume f641fb9e-0968-47a8-8f67-266211e20da8 from mountpoint /dev/vdb
Nov 10 22:50:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Attempting to detach device vdb from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:50:13 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:13 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:50:13 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:50:13 user nova-compute[75288]:   <serial>f641fb9e-0968-47a8-8f67-266211e20da8</serial>
Nov 10 22:50:13 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:50:13 user nova-compute[75288]: </disk>
Nov 10 22:50:13 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:50:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully detached device vdb from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the persistent domain config.
Nov 10 22:50:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:50:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:50:13 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:13 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:50:13 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:50:13 user nova-compute[75288]:   <serial>f641fb9e-0968-47a8-8f67-266211e20da8</serial>
Nov 10 22:50:13 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:50:13 user nova-compute[75288]: </disk>
Nov 10 22:50:13 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:50:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:50:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Instance spawned successfully.
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8bc0d202-df03-4e8a-9151-cc01dea57a34 req-a095cb5c-d8b2-40d7-a21a-7b0832ada255 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Received event network-vif-plugged-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8bc0d202-df03-4e8a-9151-cc01dea57a34 req-a095cb5c-d8b2-40d7-a21a-7b0832ada255 service nova] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8bc0d202-df03-4e8a-9151-cc01dea57a34 req-a095cb5c-d8b2-40d7-a21a-7b0832ada255 service nova] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8bc0d202-df03-4e8a-9151-cc01dea57a34 req-a095cb5c-d8b2-40d7-a21a-7b0832ada255 service nova] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8bc0d202-df03-4e8a-9151-cc01dea57a34 req-a095cb5c-d8b2-40d7-a21a-7b0832ada255 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] No waiting events found dispatching network-vif-plugged-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:15 user nova-compute[75288]: WARNING nova.compute.manager [req-8bc0d202-df03-4e8a-9151-cc01dea57a34 req-a095cb5c-d8b2-40d7-a21a-7b0832ada255 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Received unexpected event network-vif-plugged-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 for instance with vm_state building and task_state spawning.
Nov 10 22:50:15 user nova-compute[75288]: INFO nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Took 7.10 seconds to spawn the instance on the hypervisor.
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:50:15 user nova-compute[75288]: INFO nova.compute.manager [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Took 8.35 seconds to build instance.
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d999f9a2-accc-4229-af85-e53a50586ec8 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.507s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:15 user nova-compute[75288]: INFO nova.compute.manager [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Terminating instance
Nov 10 22:50:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9392507-d1a5-4972-a883-dedb50575f84 req-ba7ba1d8-8ea8-4b58-8bda-dcdc41ead747 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-unplugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9392507-d1a5-4972-a883-dedb50575f84 req-ba7ba1d8-8ea8-4b58-8bda-dcdc41ead747 service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9392507-d1a5-4972-a883-dedb50575f84 req-ba7ba1d8-8ea8-4b58-8bda-dcdc41ead747 service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9392507-d1a5-4972-a883-dedb50575f84 req-ba7ba1d8-8ea8-4b58-8bda-dcdc41ead747 service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9392507-d1a5-4972-a883-dedb50575f84 req-ba7ba1d8-8ea8-4b58-8bda-dcdc41ead747 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-unplugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9392507-d1a5-4972-a883-dedb50575f84 req-ba7ba1d8-8ea8-4b58-8bda-dcdc41ead747 service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-unplugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBfreWyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:50:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:50:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:50:16 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbcc143-32ca-4c64-8f7a-dc20a154042b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:50:16 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae87f7-a571-4ea8-a7cf-9627dcd30997]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157] added
Nov 10 22:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf032c-c19a-41c2-aff3-18f8624e8845]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23ac550-7096-4ac8-8433-b86d2e26fa1c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBfreWyL {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBfreWyL" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[486ddffd-c25f-4eaf-893e-c85d6eb760f6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qBfreWyL'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5675bf-a935-4705-abf9-3c77387437b4]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1323b2d9-dc4a-4535-813e-29aa44fce101]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Instance destroyed successfully.
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lazy-loading 'resources' on Instance uuid 032de95e-98a7-411d-8726-5bf3a5c0ca49 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1152148507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1152148507',id=1,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4325393aa3434c2a87912895d4574812',ramdisk_id='',reservation_id='r-g4ay9qdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-244383607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:36:23Z,user_data=None,user_id='07d1ae0425e64057b3b2220d4bb02624',uuid=032de95e-98a7-411d-8726-5bf3a5c0ca49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converting VIF {"id": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "address": "fa:16:3e:87:00:1a", "network": {"id": "8ac61af4-1bb9-4093-9eba-29c9972972b3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-73983923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4325393aa3434c2a87912895d4574812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33009f-d2", "ovs_interfaceid": "3c33009f-d20a-4dd9-8e7a-134b4a50b382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:00:1a,bridge_name='br-int',has_traffic_filtering=True,id=3c33009f-d20a-4dd9-8e7a-134b4a50b382,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33009f-d2') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_vif [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:00:1a,bridge_name='br-int',has_traffic_filtering=True,id=3c33009f-d20a-4dd9-8e7a-134b4a50b382,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33009f-d2') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335105c-690a-443c-a25f-0a92c9214d84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260]
Nov 10 22:50:16 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260] successful.
Nov 10 22:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c33009f-d2, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af745d47-3502-41bc-8455-c1dc6257559d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:16 user nova-compute[75288]: INFO os_vif [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:00:1a,bridge_name='br-int',has_traffic_filtering=True,id=3c33009f-d20a-4dd9-8e7a-134b4a50b382,network=Network(8ac61af4-1bb9-4093-9eba-29c9972972b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33009f-d2')
Nov 10 22:50:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Deleting instance files /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49_del
Nov 10 22:50:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Deletion of /opt/stack/data/nova/instances/032de95e-98a7-411d-8726-5bf3a5c0ca49_del complete
Nov 10 22:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.048s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c72946-31f1-41f7-917e-e2f28a8fb4ac]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40359d29-2bb5-44aa-af45-67894acf05f6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)
Nov 10 22:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:17 user nova-compute[75288]: INFO nova.compute.manager [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 10 22:50:17 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ca412-2ed6-4e19-be6a-053325f03a4a]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBfreWyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '26338386330663335', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338386330663335', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:50:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:18 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:50:18 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:50:18 user nova-compute[75288]:   <serial>984c8acb-8712-4206-b216-70f69a783157</serial>
Nov 10 22:50:18 user nova-compute[75288]: </disk>
Nov 10 22:50:18 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:18 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Took 1.15 seconds to deallocate network for instance.
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:18 user nova-compute[75288]: WARNING nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received unexpected event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with vm_state deleted and task_state None.
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:18 user nova-compute[75288]: WARNING nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received unexpected event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with vm_state deleted and task_state None.
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:18 user nova-compute[75288]: WARNING nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received unexpected event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with vm_state deleted and task_state None.
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-unplugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-unplugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:18 user nova-compute[75288]: WARNING nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received unexpected event network-vif-unplugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with vm_state deleted and task_state None.
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Acquiring lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] No waiting events found dispatching network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:50:18 user nova-compute[75288]: WARNING nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received unexpected event network-vif-plugged-3c33009f-d20a-4dd9-8e7a-134b4a50b382 for instance with vm_state deleted and task_state None.
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-39e404a0-443a-4f66-99cf-ca25ca20c2f0 req-72dab6ef-7a8c-4d09-936a-45105dd338ad service nova] [instance: 032de95e-98a7-411d-8726-5bf3a5c0ca49] Received event network-vif-deleted-3c33009f-d20a-4dd9-8e7a-134b4a50b382 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No VIF found with MAC fa:16:3e:81:41:97, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:18 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Deleted allocations for instance 032de95e-98a7-411d-8726-5bf3a5c0ca49
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-180a09c7-0a5a-4833-88be-88c6df59f13c tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.785s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb20c9f1-d4f6-4053-8b4a-f78cd6d270b1 tempest-ServerBootFromVolumeStableRescueTest-244383607 tempest-ServerBootFromVolumeStableRescueTest-244383607-project-member] Lock "032de95e-98a7-411d-8726-5bf3a5c0ca49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.909s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:21 user nova-compute[75288]: INFO nova.compute.manager [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Detaching volume 984c8acb-8712-4206-b216-70f69a783157
Nov 10 22:50:21 user nova-compute[75288]: INFO nova.virt.block_device [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attempting to driver detach volume 984c8acb-8712-4206-b216-70f69a783157 from mountpoint /dev/vdb
Nov 10 22:50:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Attempting to detach device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:50:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:50:21 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:21 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:50:21 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:50:21 user nova-compute[75288]:   <serial>984c8acb-8712-4206-b216-70f69a783157</serial>
Nov 10 22:50:21 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:50:21 user nova-compute[75288]: </disk>
Nov 10 22:50:21 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:50:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config.
Nov 10 22:50:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:50:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:50:21 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:21 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:50:21 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:50:21 user nova-compute[75288]:   <serial>984c8acb-8712-4206-b216-70f69a783157</serial>
Nov 10 22:50:21 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:50:21 user nova-compute[75288]: </disk>
Nov 10 22:50:21 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:50:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:50:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:50:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:50:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:50:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:50:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Updating instance_info_cache with network_info: [{"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:50:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-57a2b622-7db5-47f7-a51e-b3544b898306" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:50:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:50:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:50:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:50:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:50:31 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:31 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7661MB free_disk=25.239151000976562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0f78309d-5e39-4a65-a375-96f43b4ad21f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:31 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:50:32 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:50:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:50:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:34 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d is timed out.
Nov 10 22:50:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully detached device vdb from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the live domain config.
Nov 10 22:50:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiACBSvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:50:34 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bf03d3-3ad8-4411-a72a-b198a613e8db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:50:34 user nova-compute[75288]: No targets found.
Nov 10 22:50:34 user nova-compute[75288]: iSNS:
Nov 10 22:50:34 user nova-compute[75288]: No targets found.
Nov 10 22:50:34 user nova-compute[75288]: STATIC:
Nov 10 22:50:34 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4
Nov 10 22:50:34 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:34 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:34 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:50:34 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:34 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:34 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157
Nov 10 22:50:34 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:34 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:34 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8
Nov 10 22:50:34 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:34 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:34 user nova-compute[75288]: FIRMWARE:
Nov 10 22:50:34 user nova-compute[75288]: No targets found.
Nov 10 22:50:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:50:34 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:50:34 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ffb02d-6915-4a39-bbc2-4a304bc4347c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae67b8f-f5c9-4b7f-887f-b2d37316f1de]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:34 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:34 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:34 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)
Nov 10 22:50:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:34 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 (non-flash)
Nov 10 22:50:34 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:34 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)
Nov 10 22:50:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10385090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b87500-97d9-40ce-ba0e-d84d0e47f1f7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[411d0e17-e2fa-4f2e-a63e-171ce51c79d2]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1922d574-8a69-459c-b1b5-ac10243ce130]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9520a7f-d9c9-4995-95b5-a9379105beba]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eb8f23-d9e5-443b-9738-33172ec08144]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b5d23c-86b4-42bf-829d-be7b85fbb6f4]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260]
Nov 10 22:50:34 user nova-compute[75288]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8, portal: 172.16.0.220,3260] successful.
Nov 10 22:50:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f641fb9e-0968-47a8-8f67-266211e20da8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46de920-26d6-4f5e-8ab7-72ed692bd21a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== disconnect_volume: return (307ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:50:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6180e7da-09f8-4c5d-8f0f-41cdff69d231 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.097s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:36 user nova-compute[75288]: INFO nova.compute.manager [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Detaching volume c5bc89e7-5136-41f1-8356-5c0326d0dae4
Nov 10 22:50:37 user nova-compute[75288]: INFO nova.virt.block_device [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Attempting to driver detach volume c5bc89e7-5136-41f1-8356-5c0326d0dae4 from mountpoint /dev/vdc
Nov 10 22:50:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Attempting to detach device vdc from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:50:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:50:37 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:37 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:50:37 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:50:37 user nova-compute[75288]:   <serial>c5bc89e7-5136-41f1-8356-5c0326d0dae4</serial>
Nov 10 22:50:37 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 22:50:37 user nova-compute[75288]: </disk>
Nov 10 22:50:37 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:50:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully detached device vdc from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the persistent domain config.
Nov 10 22:50:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:50:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:50:37 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:50:37 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:50:37 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:50:37 user nova-compute[75288]:   <serial>c5bc89e7-5136-41f1-8356-5c0326d0dae4</serial>
Nov 10 22:50:37 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 22:50:37 user nova-compute[75288]: </disk>
Nov 10 22:50:37 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:50:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:50:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:42 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 is timed out.
Nov 10 22:50:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config.
Nov 10 22:50:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBfreWyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:50:42 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc860b-178d-47d3-835d-151216aacf9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:50:42 user nova-compute[75288]: No targets found.
Nov 10 22:50:42 user nova-compute[75288]: iSNS:
Nov 10 22:50:42 user nova-compute[75288]: No targets found.
Nov 10 22:50:42 user nova-compute[75288]: STATIC:
Nov 10 22:50:42 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4
Nov 10 22:50:42 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:42 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:42 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:50:42 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:42 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:42 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157
Nov 10 22:50:42 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:42 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:42 user nova-compute[75288]: FIRMWARE:
Nov 10 22:50:42 user nova-compute[75288]: No targets found.
Nov 10 22:50:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:50:42 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:50:42 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1602a6b4-3181-45cb-ac8d-c1e548aa0e61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[356c777e-58f2-4fcd-99fb-c0e34266a28e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:42 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:42 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)
Nov 10 22:50:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:42 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:42 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 (non-flash)
Nov 10 22:50:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b20116b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9234aa3-c299-4902-b44b-2289be4e755c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d139b-a981-4fcd-9ac0-493d45f50361]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dfceae-cd6d-450e-a941-05209592eb89]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ad028-c515-4188-b0b6-fb04de7e789f]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b432465f-b3ec-4d8c-81ad-46ba64b31140]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e6c349-fcce-47e3-862e-47a3261837aa]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260]
Nov 10 22:50:42 user nova-compute[75288]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157, portal: 172.16.0.220,3260] successful.
Nov 10 22:50:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984c8acb-8712-4206-b216-70f69a783157 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad7664-2634-4ca9-b03f-05afd2d7671b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== disconnect_volume: return (298ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:50:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:50:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:50:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-482442d6-a95a-4412-af88-18e11f28acd8 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.958s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:50:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:50 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:50:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 22:50:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 22:50:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance has had 1 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 22:50:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Deletion of /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize failed
Nov 10 22:50:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:50:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d is timed out.
Nov 10 22:50:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully detached device vdc from instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d from the live domain config.
Nov 10 22:50:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyNenIjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:50:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1800577b-ac6d-4e53-9789-d5a94c655a80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:50:57 user nova-compute[75288]: No targets found.
Nov 10 22:50:57 user nova-compute[75288]: iSNS:
Nov 10 22:50:57 user nova-compute[75288]: No targets found.
Nov 10 22:50:57 user nova-compute[75288]: STATIC:
Nov 10 22:50:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4
Nov 10 22:50:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:57 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:50:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:50:57 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:50:57 user nova-compute[75288]: FIRMWARE:
Nov 10 22:50:57 user nova-compute[75288]: No targets found.
Nov 10 22:50:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:50:57 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:50:57 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[70771b21-b442-4e1c-b53a-81c19a96c29f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57fdb90-8015-4093-8e2c-d1d26e9a2fbd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:57 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:50:57 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 (non-flash)
Nov 10 22:50:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10386a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab2bb0f-53ee-44ec-bcea-d8805731c094]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[761bf75f-9d26-43eb-8560-324b4c152dd0]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[968316ae-59af-49df-935a-268ab2dad0fe]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fc0b1e-d652-431b-a3d4-fe43f830da9e]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a01fff3-0352-46c5-b97c-7c1086de915a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76a1966-8111-475a-8e2b-c80f8080c963]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260]
Nov 10 22:50:57 user nova-compute[75288]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4, portal: 172.16.0.220,3260] successful.
Nov 10 22:50:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bc89e7-5136-41f1-8356-5c0326d0dae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d754d7a5-90b9-47d5-8ceb-b0b3801f021b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] <== disconnect_volume: return (278ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:50:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:50:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:10 user nova-compute[75288]: DEBUG nova.objects.instance [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'flavor' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-88291ef7-a26b-4e58-883a-b66523869aa7 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.662s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 5f06057c-abec-4ae3-ac9e-2cdede2cad3f {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 57a2b622-7db5-47f7-a51e-b3544b898306 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid b1a7d533-cad6-4360-b6c4-f12c6fc473a8 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 0f78309d-5e39-4a65-a375-96f43b4ad21f {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "57a2b622-7db5-47f7-a51e-b3544b898306" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "57a2b622-7db5-47f7-a51e-b3544b898306" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:11 user nova-compute[75288]: INFO nova.compute.manager [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Terminating instance
Nov 10 22:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-aa4f3626-53a3-4e35-9e00-d9dbdd2fe62a req-bdbae176-44fc-471f-8fda-d538feda8659 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-vif-unplugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aa4f3626-53a3-4e35-9e00-d9dbdd2fe62a req-bdbae176-44fc-471f-8fda-d538feda8659 service nova] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aa4f3626-53a3-4e35-9e00-d9dbdd2fe62a req-bdbae176-44fc-471f-8fda-d538feda8659 service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aa4f3626-53a3-4e35-9e00-d9dbdd2fe62a req-bdbae176-44fc-471f-8fda-d538feda8659 service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-aa4f3626-53a3-4e35-9e00-d9dbdd2fe62a req-bdbae176-44fc-471f-8fda-d538feda8659 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] No waiting events found dispatching network-vif-unplugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-aa4f3626-53a3-4e35-9e00-d9dbdd2fe62a req-bdbae176-44fc-471f-8fda-d538feda8659 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-vif-unplugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:51:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Instance destroyed successfully.
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lazy-loading 'resources' on Instance uuid f6b48e8c-3cc2-4121-84fe-ae84fcae327d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-295127794',display_name='tempest-AttachVolumeTestJSON-server-295127794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-295127794',id=27,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWrr6N4qRqSnzmK9Sqh2sozZXJn8Z1v1BY0Xmn1LHauWJMt//FfrYX2vs7J0WyltRqydGBOV0iWT7ziffx4kj+PIFC8Y8FKdrTsl70wtxqJkbQ8cwTT/brMIsAo+ecd1w==',key_name='tempest-keypair-1291823449',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:46:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28bbf495a59c4f24945da89346c71dff',ramdisk_id='',reservation_id='r-4sx4qp62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-979908124',owner_user_name='tempest-AttachVolumeTestJSON-979908124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:46:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b930fa714405192e875eaf51cff95',uuid=f6b48e8c-3cc2-4121-84fe-ae84fcae327d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converting VIF {"id": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "address": "fa:16:3e:06:c2:db", "network": {"id": "f10dceef-253d-4f1e-a6aa-673022fab723", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-583951084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28bbf495a59c4f24945da89346c71dff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712a83c2-bc", "ovs_interfaceid": "712a83c2-bcc4-4e16-974c-9b40d6b237aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=712a83c2-bcc4-4e16-974c-9b40d6b237aa,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712a83c2-bc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG os_vif [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=712a83c2-bcc4-4e16-974c-9b40d6b237aa,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712a83c2-bc') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap712a83c2-bc, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=495eb3ce-0228-4758-9f5e-a222efa7a318) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:12 user nova-compute[75288]: INFO os_vif [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=712a83c2-bcc4-4e16-974c-9b40d6b237aa,network=Network(f10dceef-253d-4f1e-a6aa-673022fab723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712a83c2-bc')
Nov 10 22:51:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Deleting instance files /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d_del
Nov 10 22:51:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Deletion of /opt/stack/data/nova/instances/f6b48e8c-3cc2-4121-84fe-ae84fcae327d_del complete
Nov 10 22:51:12 user nova-compute[75288]: INFO nova.compute.manager [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 10 22:51:12 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:51:12 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-a1f2df7d-4ddf-4364-9144-aac21e8a37c1 req-59f6b46b-1c91-46f5-959e-a1c4d6a3cf14 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a1f2df7d-4ddf-4364-9144-aac21e8a37c1 req-59f6b46b-1c91-46f5-959e-a1c4d6a3cf14 service nova] Acquiring lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a1f2df7d-4ddf-4364-9144-aac21e8a37c1 req-59f6b46b-1c91-46f5-959e-a1c4d6a3cf14 service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a1f2df7d-4ddf-4364-9144-aac21e8a37c1 req-59f6b46b-1c91-46f5-959e-a1c4d6a3cf14 service nova] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-a1f2df7d-4ddf-4364-9144-aac21e8a37c1 req-59f6b46b-1c91-46f5-959e-a1c4d6a3cf14 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] No waiting events found dispatching network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:14 user nova-compute[75288]: WARNING nova.compute.manager [req-a1f2df7d-4ddf-4364-9144-aac21e8a37c1 req-59f6b46b-1c91-46f5-959e-a1c4d6a3cf14 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received unexpected event network-vif-plugged-712a83c2-bcc4-4e16-974c-9b40d6b237aa for instance with vm_state active and task_state deleting.
Nov 10 22:51:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:51:14 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Took 1.65 seconds to deallocate network for instance.
Nov 10 22:51:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-5384b156-3a3d-4cdb-8d93-ba26d3a3d036 req-be966169-d37a-4bab-9408-8a3a3029b496 service nova] [instance: f6b48e8c-3cc2-4121-84fe-ae84fcae327d] Received event network-vif-deleted-712a83c2-bcc4-4e16-974c-9b40d6b237aa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:15 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Deleted allocations for instance f6b48e8c-3cc2-4121-84fe-ae84fcae327d
Nov 10 22:51:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c744b0b-ac71-40c8-bd18-9502e495f128 tempest-AttachVolumeTestJSON-979908124 tempest-AttachVolumeTestJSON-979908124-project-member] Lock "f6b48e8c-3cc2-4121-84fe-ae84fcae327d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.302s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:51:23 user nova-compute[75288]: INFO nova.compute.claims [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Claim successful on node user
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:51:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.policy [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9010fc645ad54495bd090cfffad16a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9547e47532da49bcb20296c6485577a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:51:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Creating image(s)
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk 1073741824" returned: 0 in 0.064s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Successfully created port: fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Cannot resize image /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Ensure instance console log exists: /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Successfully updated port: fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing instance network info cache due to event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance network_info: |[{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Start _get_guest_xml network_info=[{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:51:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:51:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-970360194',display_name='tempest-ServerStableDeviceRescueTest-server-970360194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-970360194',id=31,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObVP8O6Nr1VHNeR/aDPh9glerFl/Ksu5hCAH/IB2ClN5ICro3vIhpZ6yIeZWAv3x/Z6at08dxbuQqBi0goqSR/VYzNupGo0JUKcvS6bysNUtzCZg+QESV5SyOA+OzoGwQ==',key_name='tempest-keypair-1094930237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9547e47532da49bcb20296c6485577a2',ramdisk_id='',reservation_id='r-x5apaqpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-239004557',owner_user_name='tempest-ServerStableDeviceRescueTest-239004557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9010fc645ad54495bd090cfffad16a0e',uuid=04509269-e685-4bdb-8663-6c4a27fb8169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converting VIF {"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.objects.instance [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'pci_devices' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:51:25 user nova-compute[75288]:   <uuid>04509269-e685-4bdb-8663-6c4a27fb8169</uuid>
Nov 10 22:51:25 user nova-compute[75288]:   <name>instance-0000001f</name>
Nov 10 22:51:25 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:51:25 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:51:25 user nova-compute[75288]:   <metadata>
Nov 10 22:51:25 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:51:25 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:51:25 user nova-compute[75288]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-970360194</nova:name>
Nov 10 22:51:25 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:51:25</nova:creationTime>
Nov 10 22:51:25 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:51:25 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:51:25 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:51:25 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:51:25 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:51:25 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:51:25 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:51:25 user nova-compute[75288]:       <nova:owner>
Nov 10 22:51:25 user nova-compute[75288]:         <nova:user uuid="9010fc645ad54495bd090cfffad16a0e">tempest-ServerStableDeviceRescueTest-239004557-project-member</nova:user>
Nov 10 22:51:25 user nova-compute[75288]:         <nova:project uuid="9547e47532da49bcb20296c6485577a2">tempest-ServerStableDeviceRescueTest-239004557</nova:project>
Nov 10 22:51:25 user nova-compute[75288]:       </nova:owner>
Nov 10 22:51:25 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:51:25 user nova-compute[75288]:       <nova:ports>
Nov 10 22:51:25 user nova-compute[75288]:         <nova:port uuid="fc3f6fa3-d1c2-4c8b-a442-15071214b6c8">
Nov 10 22:51:25 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 22:51:25 user nova-compute[75288]:         </nova:port>
Nov 10 22:51:25 user nova-compute[75288]:       </nova:ports>
Nov 10 22:51:25 user nova-compute[75288]:     </nova:instance>
Nov 10 22:51:25 user nova-compute[75288]:   </metadata>
Nov 10 22:51:25 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:51:25 user nova-compute[75288]:     <system>
Nov 10 22:51:25 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:51:25 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:51:25 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:51:25 user nova-compute[75288]:       <entry name="serial">04509269-e685-4bdb-8663-6c4a27fb8169</entry>
Nov 10 22:51:25 user nova-compute[75288]:       <entry name="uuid">04509269-e685-4bdb-8663-6c4a27fb8169</entry>
Nov 10 22:51:25 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:51:25 user nova-compute[75288]:     </system>
Nov 10 22:51:25 user nova-compute[75288]:   </sysinfo>
Nov 10 22:51:25 user nova-compute[75288]:   <os>
Nov 10 22:51:25 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:51:25 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:51:25 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:51:25 user nova-compute[75288]:   </os>
Nov 10 22:51:25 user nova-compute[75288]:   <features>
Nov 10 22:51:25 user nova-compute[75288]:     <acpi/>
Nov 10 22:51:25 user nova-compute[75288]:     <apic/>
Nov 10 22:51:25 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:51:25 user nova-compute[75288]:   </features>
Nov 10 22:51:25 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:51:25 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:51:25 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:51:25 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:51:25 user nova-compute[75288]:   </clock>
Nov 10 22:51:25 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:51:25 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:51:25 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:51:25 user nova-compute[75288]:   </cpu>
Nov 10 22:51:25 user nova-compute[75288]:   <devices>
Nov 10 22:51:25 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:51:25 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:51:25 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk"/>
Nov 10 22:51:25 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:51:25 user nova-compute[75288]:     </disk>
Nov 10 22:51:25 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:51:25 user nova-compute[75288]:       <mac address="fa:16:3e:c7:79:ec"/>
Nov 10 22:51:25 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:51:25 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:51:25 user nova-compute[75288]:       <target dev="tapfc3f6fa3-d1"/>
Nov 10 22:51:25 user nova-compute[75288]:     </interface>
Nov 10 22:51:25 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:51:25 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/console.log" append="off"/>
Nov 10 22:51:25 user nova-compute[75288]:     </serial>
Nov 10 22:51:25 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:51:25 user nova-compute[75288]:     <video>
Nov 10 22:51:25 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:51:25 user nova-compute[75288]:     </video>
Nov 10 22:51:25 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:51:25 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:51:25 user nova-compute[75288]:     </rng>
Nov 10 22:51:25 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:51:25 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:51:25 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:51:25 user nova-compute[75288]:     </memballoon>
Nov 10 22:51:25 user nova-compute[75288]:   </devices>
Nov 10 22:51:25 user nova-compute[75288]: </domain>
Nov 10 22:51:25 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-970360194',display_name='tempest-ServerStableDeviceRescueTest-server-970360194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-970360194',id=31,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObVP8O6Nr1VHNeR/aDPh9glerFl/Ksu5hCAH/IB2ClN5ICro3vIhpZ6yIeZWAv3x/Z6at08dxbuQqBi0goqSR/VYzNupGo0JUKcvS6bysNUtzCZg+QESV5SyOA+OzoGwQ==',key_name='tempest-keypair-1094930237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9547e47532da49bcb20296c6485577a2',ramdisk_id='',reservation_id='r-x5apaqpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-239004557',owner_user_name='tempest-ServerStableDeviceRescueTest-239004557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9010fc645ad54495bd090cfffad16a0e',uuid=04509269-e685-4bdb-8663-6c4a27fb8169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converting VIF {"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG os_vif [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bae666d-210e-53fd-8c62-d80014433506', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc3f6fa3-d1, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc3f6fa3-d1, col_values=(('qos', UUID('1cebf193-1f12-469d-b015-eca4616a8b22')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc3f6fa3-d1, col_values=(('external_ids', {'iface-id': 'fc3f6fa3-d1c2-4c8b-a442-15071214b6c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:79:ec', 'vm-uuid': '04509269-e685-4bdb-8663-6c4a27fb8169'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:25 user nova-compute[75288]: INFO os_vif [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1')
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No VIF found with MAC fa:16:3e:c7:79:ec, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:51:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:26 user nova-compute[75288]: INFO nova.compute.manager [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attaching volume 23d7ee32-0933-4358-adc4-648c5dbdfbe9 to /dev/vdb
Nov 10 22:51:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updated VIF entry in instance network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f580e8-a3bf-4300-9bc6-122fc299175b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a0e2dc52-ed54-4788-ae67-9f41c318a9fb req-8355d184-1954-40aa-8fce-458690cd968d service nova] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8d0303-802b-4475-a2d0-c0a74216a76a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ddf725-f2a2-4b55-a3b7-4b79aa11f1d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6fd82-fd5f-4440-b0ad-555fc206a245]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:51:26 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[874e2dc9-e643-425e-bffa-d180ec74b876]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating existing volume attachment record: 70fec6de-758d-4a29-8402-7f6b1fe2c2cb {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating instance_info_cache with network_info: [{"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:51:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-43179c9f-e870-4cff-9477-b59c43f9e724 req-75eeb6de-36a7-4080-be02-1f99527fe8ef service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-43179c9f-e870-4cff-9477-b59c43f9e724 req-75eeb6de-36a7-4080-be02-1f99527fe8ef service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-43179c9f-e870-4cff-9477-b59c43f9e724 req-75eeb6de-36a7-4080-be02-1f99527fe8ef service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-43179c9f-e870-4cff-9477-b59c43f9e724 req-75eeb6de-36a7-4080-be02-1f99527fe8ef service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-43179c9f-e870-4cff-9477-b59c43f9e724 req-75eeb6de-36a7-4080-be02-1f99527fe8ef service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:27 user nova-compute[75288]: WARNING nova.compute.manager [req-43179c9f-e870-4cff-9477-b59c43f9e724 req-75eeb6de-36a7-4080-be02-1f99527fe8ef service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state building and task_state spawning.
Nov 10 22:51:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:51:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance spawned successfully.
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:51:29 user nova-compute[75288]: INFO nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-e2e10961-aa63-4e4f-bcba-b725432ad875 req-f2c3a505-d4e7-4818-9503-9175dc3ae65f service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e2e10961-aa63-4e4f-bcba-b725432ad875 req-f2c3a505-d4e7-4818-9503-9175dc3ae65f service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e2e10961-aa63-4e4f-bcba-b725432ad875 req-f2c3a505-d4e7-4818-9503-9175dc3ae65f service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e2e10961-aa63-4e4f-bcba-b725432ad875 req-f2c3a505-d4e7-4818-9503-9175dc3ae65f service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-e2e10961-aa63-4e4f-bcba-b725432ad875 req-f2c3a505-d4e7-4818-9503-9175dc3ae65f service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:29 user nova-compute[75288]: WARNING nova.compute.manager [req-e2e10961-aa63-4e4f-bcba-b725432ad875 req-f2c3a505-d4e7-4818-9503-9175dc3ae65f service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state building and task_state spawning.
Nov 10 22:51:29 user nova-compute[75288]: INFO nova.compute.manager [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Took 6.96 seconds to build instance.
Nov 10 22:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07f6b3c6-89dc-4b7b-97a8-0b0051c9d746 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.067s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:51:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7792MB free_disk=25.22266387939453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0f78309d-5e39-4a65-a375-96f43b4ad21f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:51:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:51:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:51:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:51:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:47 user nova-compute[75288]: INFO nova.compute.manager [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Rescuing
Nov 10 22:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:51:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updating instance_info_cache with network_info: [{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-fb259112-28e6-45f6-a48a-dff0778e0f0c req-44b0a642-bbd8-41e8-8f37-b5929c3365d8 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-unplugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fb259112-28e6-45f6-a48a-dff0778e0f0c req-44b0a642-bbd8-41e8-8f37-b5929c3365d8 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fb259112-28e6-45f6-a48a-dff0778e0f0c req-44b0a642-bbd8-41e8-8f37-b5929c3365d8 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fb259112-28e6-45f6-a48a-dff0778e0f0c req-44b0a642-bbd8-41e8-8f37-b5929c3365d8 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-fb259112-28e6-45f6-a48a-dff0778e0f0c req-44b0a642-bbd8-41e8-8f37-b5929c3365d8 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-unplugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:48 user nova-compute[75288]: WARNING nova.compute.manager [req-fb259112-28e6-45f6-a48a-dff0778e0f0c req-44b0a642-bbd8-41e8-8f37-b5929c3365d8 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received unexpected event network-vif-unplugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with vm_state active and task_state rescuing.
Nov 10 22:51:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance destroyed successfully.
Nov 10 22:51:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Attempting rescue
Nov 10 22:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 22:51:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Creating image(s)
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'trusted_certs' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue" returned: 0 in 0.063s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'migration_context' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.base [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<ad132b9c-5de3-4d1a-ab55-4e95d589df45> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Start _get_guest_xml network_info=[{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:2c:74:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'resources' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.base [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<ad132b9c-5de3-4d1a-ab55-4e95d589df45> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'numa_topology' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.base [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<ad132b9c-5de3-4d1a-ab55-4e95d589df45> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:51:49 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:51:49 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.base [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<ad132b9c-5de3-4d1a-ab55-4e95d589df45> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-888792900',display_name='tempest-ServerRescueNegativeTestJSON-server-888792900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-888792900',id=29,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:50:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-nim7tncv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:50:07Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=ad132b9c-5de3-4d1a-ab55-4e95d589df45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:2c:74:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:2c:74:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'pci_devices' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.objects.base [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<ad132b9c-5de3-4d1a-ab55-4e95d589df45> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:51:49 user nova-compute[75288]:   <uuid>ad132b9c-5de3-4d1a-ab55-4e95d589df45</uuid>
Nov 10 22:51:49 user nova-compute[75288]:   <name>instance-0000001d</name>
Nov 10 22:51:49 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:51:49 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:51:49 user nova-compute[75288]:   <metadata>
Nov 10 22:51:49 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:51:49 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:51:49 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-888792900</nova:name>
Nov 10 22:51:49 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:51:49</nova:creationTime>
Nov 10 22:51:49 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:51:49 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:51:49 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:51:49 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:51:49 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:51:49 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:51:49 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:51:49 user nova-compute[75288]:       <nova:owner>
Nov 10 22:51:49 user nova-compute[75288]:         <nova:user uuid="8aa64d78d0ed47e9af81121ea1e9e34a">tempest-ServerRescueNegativeTestJSON-423881024-project-member</nova:user>
Nov 10 22:51:49 user nova-compute[75288]:         <nova:project uuid="0fb8bee5841243ecbc00a012f27016fe">tempest-ServerRescueNegativeTestJSON-423881024</nova:project>
Nov 10 22:51:49 user nova-compute[75288]:       </nova:owner>
Nov 10 22:51:49 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:51:49 user nova-compute[75288]:       <nova:ports>
Nov 10 22:51:49 user nova-compute[75288]:         <nova:port uuid="3b62047c-54d3-41ba-a037-230d76298105">
Nov 10 22:51:49 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 22:51:49 user nova-compute[75288]:         </nova:port>
Nov 10 22:51:49 user nova-compute[75288]:       </nova:ports>
Nov 10 22:51:49 user nova-compute[75288]:     </nova:instance>
Nov 10 22:51:49 user nova-compute[75288]:   </metadata>
Nov 10 22:51:49 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:51:49 user nova-compute[75288]:     <system>
Nov 10 22:51:49 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:51:49 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:51:49 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:51:49 user nova-compute[75288]:       <entry name="serial">ad132b9c-5de3-4d1a-ab55-4e95d589df45</entry>
Nov 10 22:51:49 user nova-compute[75288]:       <entry name="uuid">ad132b9c-5de3-4d1a-ab55-4e95d589df45</entry>
Nov 10 22:51:49 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:51:49 user nova-compute[75288]:     </system>
Nov 10 22:51:49 user nova-compute[75288]:   </sysinfo>
Nov 10 22:51:49 user nova-compute[75288]:   <os>
Nov 10 22:51:49 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:51:49 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:51:49 user nova-compute[75288]:   </os>
Nov 10 22:51:49 user nova-compute[75288]:   <features>
Nov 10 22:51:49 user nova-compute[75288]:     <acpi/>
Nov 10 22:51:49 user nova-compute[75288]:     <apic/>
Nov 10 22:51:49 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:51:49 user nova-compute[75288]:   </features>
Nov 10 22:51:49 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:51:49 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:51:49 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:51:49 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:51:49 user nova-compute[75288]:   </clock>
Nov 10 22:51:49 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:51:49 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:51:49 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:51:49 user nova-compute[75288]:   </cpu>
Nov 10 22:51:49 user nova-compute[75288]:   <devices>
Nov 10 22:51:49 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:51:49 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:51:49 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue"/>
Nov 10 22:51:49 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:51:49 user nova-compute[75288]:     </disk>
Nov 10 22:51:49 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:51:49 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:51:49 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk"/>
Nov 10 22:51:49 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:51:49 user nova-compute[75288]:     </disk>
Nov 10 22:51:49 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:51:49 user nova-compute[75288]:       <mac address="fa:16:3e:2c:74:f2"/>
Nov 10 22:51:49 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:51:49 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:51:49 user nova-compute[75288]:       <target dev="tap3b62047c-54"/>
Nov 10 22:51:49 user nova-compute[75288]:     </interface>
Nov 10 22:51:49 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:51:49 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/console.log" append="off"/>
Nov 10 22:51:49 user nova-compute[75288]:     </serial>
Nov 10 22:51:49 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:51:49 user nova-compute[75288]:     <video>
Nov 10 22:51:49 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:51:49 user nova-compute[75288]:     </video>
Nov 10 22:51:49 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:51:49 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:51:49 user nova-compute[75288]:     </rng>
Nov 10 22:51:49 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:51:49 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:51:49 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:51:49 user nova-compute[75288]:     </memballoon>
Nov 10 22:51:49 user nova-compute[75288]:   </devices>
Nov 10 22:51:49 user nova-compute[75288]: </domain>
Nov 10 22:51:49 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:51:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance destroyed successfully.
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No VIF found with MAC fa:16:3e:2c:74:f2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:51:49 user nova-compute[75288]: INFO nova.compute.manager [None req-551614d1-6352-46b0-9e41-96bcf2c3319f tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Get console output
Nov 10 22:51:49 user nova-compute[75288]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 10 22:51:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-4e88bf5b-0cad-4444-bb17-a852f9c4b76f req-eaa7e181-5d32-4878-a1d6-0715ea0bbab6 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4e88bf5b-0cad-4444-bb17-a852f9c4b76f req-eaa7e181-5d32-4878-a1d6-0715ea0bbab6 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4e88bf5b-0cad-4444-bb17-a852f9c4b76f req-eaa7e181-5d32-4878-a1d6-0715ea0bbab6 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4e88bf5b-0cad-4444-bb17-a852f9c4b76f req-eaa7e181-5d32-4878-a1d6-0715ea0bbab6 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-4e88bf5b-0cad-4444-bb17-a852f9c4b76f req-eaa7e181-5d32-4878-a1d6-0715ea0bbab6 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:50 user nova-compute[75288]: WARNING nova.compute.manager [req-4e88bf5b-0cad-4444-bb17-a852f9c4b76f req-eaa7e181-5d32-4878-a1d6-0715ea0bbab6 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received unexpected event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with vm_state active and task_state rescuing.
Nov 10 22:51:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:52 user nova-compute[75288]: WARNING nova.compute.manager [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received unexpected event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with vm_state active and task_state rescuing.
Nov 10 22:51:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:51:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:51:52 user nova-compute[75288]: WARNING nova.compute.manager [req-d8c08a09-5385-436a-9a3b-3917f8b66fc5 req-21f6ea4c-9456-4612-be88-41b9882bbeb7 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received unexpected event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with vm_state active and task_state rescuing.
Nov 10 22:51:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2cf3f2cb-bf15-4d15-a08c-403d0ae3c598 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:51:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:51:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Received event network-changed-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:51:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Refreshing instance network info cache due to event network-changed-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:51:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] Acquiring lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:51:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] Acquired lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:51:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Refreshing network info cache for port 6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:51:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updated VIF entry in instance network info cache for port 6b0d0abf-11e1-45c0-80f8-8c77f0a3d720. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:51:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updating instance_info_cache with network_info: [{"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:51:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0d87fe16-9a38-4778-bd56-24911aca6d9f req-4a65852e-565c-49e6-9217-793daace177e service nova] Releasing lock "refresh_cache-0f78309d-5e39-4a65-a375-96f43b4ad21f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:51:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:52:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 22:52:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:27 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lazy-loading 'flavor' on Instance uuid 0f78309d-5e39-4a65-a375-96f43b4ad21f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:52:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:28 user nova-compute[75288]: INFO nova.compute.manager [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Attaching volume 7b281cd3-5e2e-4011-b7bb-163512a070b1 to /dev/vdb
Nov 10 22:52:28 user nova-compute[75288]: DEBUG os_brick.utils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5dd14a-be1d-45a6-a4dd-82f08a4231e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3781f-e3bd-4f05-bd78-4b264bf52c98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ab721a-52eb-4f1a-bdc7-da2b7ba531d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28090e1b-af00-46fa-9bac-5ab85c6c7a9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:52:28 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:52:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97979965-9d12-4afd-923b-3b2b6c2b969d]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG os_brick.utils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:52:28 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updating existing volume attachment record: bc7e9b53-d774-4451-b38b-9e90ebb3035b {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:52:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:52:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "57a2b622-7db5-47f7-a51e-b3544b898306" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:33 user nova-compute[75288]: INFO nova.compute.manager [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Terminating instance
Nov 10 22:52:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-d96b0850-6cf8-4bcf-beb8-9bfa43996667 req-3017f696-736c-45b0-8aa5-8996577bbfed service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-unplugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d96b0850-6cf8-4bcf-beb8-9bfa43996667 req-3017f696-736c-45b0-8aa5-8996577bbfed service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d96b0850-6cf8-4bcf-beb8-9bfa43996667 req-3017f696-736c-45b0-8aa5-8996577bbfed service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d96b0850-6cf8-4bcf-beb8-9bfa43996667 req-3017f696-736c-45b0-8aa5-8996577bbfed service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-d96b0850-6cf8-4bcf-beb8-9bfa43996667 req-3017f696-736c-45b0-8aa5-8996577bbfed service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-unplugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-d96b0850-6cf8-4bcf-beb8-9bfa43996667 req-3017f696-736c-45b0-8aa5-8996577bbfed service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-unplugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Instance destroyed successfully.
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lazy-loading 'resources' on Instance uuid 57a2b622-7db5-47f7-a51e-b3544b898306 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-439242538',display_name='tempest-ServersNegativeTestJSON-server-439242538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-439242538',id=21,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef52a00aba2b48d5904eda97ecc89861',ramdisk_id='',reservation_id='r-4faeqt0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-891085347',owner_user_name='tempest-ServersNegativeTestJSON-891085347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:43:26Z,user_data=None,user_id='b1b51c6d64044e57b9afcc85619c88e6',uuid=57a2b622-7db5-47f7-a51e-b3544b898306,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converting VIF {"id": "85f3d62a-91b8-4568-9434-06340e81c824", "address": "fa:16:3e:54:44:1e", "network": {"id": "541b8979-11d1-4ba7-bd1c-d799c2378ece", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-238084197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef52a00aba2b48d5904eda97ecc89861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f3d62a-91", "ovs_interfaceid": "85f3d62a-91b8-4568-9434-06340e81c824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:44:1e,bridge_name='br-int',has_traffic_filtering=True,id=85f3d62a-91b8-4568-9434-06340e81c824,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f3d62a-91') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG os_vif [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:44:1e,bridge_name='br-int',has_traffic_filtering=True,id=85f3d62a-91b8-4568-9434-06340e81c824,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f3d62a-91') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85f3d62a-91, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0fcb289-b411-4ea5-a630-a6fecbf8d409) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: INFO os_vif [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:44:1e,bridge_name='br-int',has_traffic_filtering=True,id=85f3d62a-91b8-4568-9434-06340e81c824,network=Network(541b8979-11d1-4ba7-bd1c-d799c2378ece),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f3d62a-91')
Nov 10 22:52:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Deleting instance files /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306_del
Nov 10 22:52:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Deletion of /opt/stack/data/nova/instances/57a2b622-7db5-47f7-a51e-b3544b898306_del complete
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: INFO nova.compute.manager [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 10 22:52:34 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:52:34 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:52:34 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=25.18191146850586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 57a2b622-7db5-47f7-a51e-b3544b898306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0f78309d-5e39-4a65-a375-96f43b4ad21f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:52:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-33828972-c023-43ce-ab0b-cb4ca8c83891 req-f087cdc0-4a1d-437e-93af-73dd13809923 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-deleted-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:35 user nova-compute[75288]: INFO nova.compute.manager [req-33828972-c023-43ce-ab0b-cb4ca8c83891 req-f087cdc0-4a1d-437e-93af-73dd13809923 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Neutron deleted interface 85f3d62a-91b8-4568-9434-06340e81c824; detaching it from the instance and deleting it from the info cache
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-33828972-c023-43ce-ab0b-cb4ca8c83891 req-f087cdc0-4a1d-437e-93af-73dd13809923 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:52:35 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Took 0.59 seconds to deallocate network for instance.
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-33828972-c023-43ce-ab0b-cb4ca8c83891 req-f087cdc0-4a1d-437e-93af-73dd13809923 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Detach interface failed, port_id=85f3d62a-91b8-4568-9434-06340e81c824, reason: Instance 57a2b622-7db5-47f7-a51e-b3544b898306 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:35 user nova-compute[75288]: WARNING nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received unexpected event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with vm_state deleted and task_state None.
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:35 user nova-compute[75288]: WARNING nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received unexpected event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with vm_state deleted and task_state None.
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:35 user nova-compute[75288]: WARNING nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received unexpected event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with vm_state deleted and task_state None.
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-unplugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-unplugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:35 user nova-compute[75288]: WARNING nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received unexpected event network-vif-unplugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with vm_state deleted and task_state None.
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Acquiring lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] Lock "57a2b622-7db5-47f7-a51e-b3544b898306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] No waiting events found dispatching network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:35 user nova-compute[75288]: WARNING nova.compute.manager [req-d86c32ce-911e-4ee1-a095-303f394b0afe req-7fb9baf4-196d-422e-b4d1-e78519e388c0 service nova] [instance: 57a2b622-7db5-47f7-a51e-b3544b898306] Received unexpected event network-vif-plugged-85f3d62a-91b8-4568-9434-06340e81c824 for instance with vm_state deleted and task_state None.
Nov 10 22:52:35 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:35 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Deleted allocations for instance 57a2b622-7db5-47f7-a51e-b3544b898306
Nov 10 22:52:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-71dca215-42b7-4fee-ba53-69908da3ffbf tempest-ServersNegativeTestJSON-891085347 tempest-ServersNegativeTestJSON-891085347-project-member] Lock "57a2b622-7db5-47f7-a51e-b3544b898306" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:52:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:52:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:52:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:52:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:52:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:52:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMeRfIXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:52:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:52:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:52:49 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9d9f6-afc5-4b05-bfae-214b594956c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:52:49 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bde115-f2dd-47aa-8d39-fe1d6c0f2d94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9] added
Nov 10 22:52:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bec7e3-c9be-49bd-9e09-1fdb34354861]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea918c-feaf-4437-bce6-dd898aa3c7aa]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMeRfIXA {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMeRfIXA" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be228b1-40d5-42f3-a6b5-d98fde02ee68]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMeRfIXA'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef4845-e797-4f1e-a6be-77ec721be0cf]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd94baf-311b-4170-a4f7-e22f8bbdd6d9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:52:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:52:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[53922c0d-825c-48e6-8c7c-0a686fe65ea7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260]
Nov 10 22:52:49 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260] successful.
Nov 10 22:52:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a559a-0ddc-484b-869e-763a57520364]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f61e863-c58f-4879-bddd-05b0718409b0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:52:49 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:52:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:52:49 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:52:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b5191-b0ba-454f-855f-2d06edf6a90b]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:52:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMeRfIXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:50 user nova-compute[75288]: INFO nova.compute.manager [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Terminating instance
Nov 10 22:52:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-0a9e9d62-f45a-4637-a514-2d51a935f496 req-8acfa4dc-225d-4969-8235-737e2e8b3c7e service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-unplugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0a9e9d62-f45a-4637-a514-2d51a935f496 req-8acfa4dc-225d-4969-8235-737e2e8b3c7e service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0a9e9d62-f45a-4637-a514-2d51a935f496 req-8acfa4dc-225d-4969-8235-737e2e8b3c7e service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0a9e9d62-f45a-4637-a514-2d51a935f496 req-8acfa4dc-225d-4969-8235-737e2e8b3c7e service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-0a9e9d62-f45a-4637-a514-2d51a935f496 req-8acfa4dc-225d-4969-8235-737e2e8b3c7e service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-unplugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-0a9e9d62-f45a-4637-a514-2d51a935f496 req-8acfa4dc-225d-4969-8235-737e2e8b3c7e service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-unplugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23432363732376131', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:52:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432363732376131', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:52:51 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:52:51 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:52:51 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:52:51 user nova-compute[75288]:   <serial>23d7ee32-0933-4358-adc4-648c5dbdfbe9</serial>
Nov 10 22:52:51 user nova-compute[75288]: </disk>
Nov 10 22:52:51 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:52:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Instance destroyed successfully.
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'resources' on Instance uuid b1a7d533-cad6-4360-b6c4-f12c6fc473a8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1858541466',display_name='tempest-ServerActionsTestOtherA-server-1858541466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1858541466',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ez96icqz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=b1a7d533-cad6-4360-b6c4-f12c6fc473a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "16999ac2-b068-479b-a705-8342b29addc7", "address": "fa:16:3e:f8:7b:57", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16999ac2-b0", "ovs_interfaceid": "16999ac2-b068-479b-a705-8342b29addc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_vif [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16999ac2-b0, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cbb8b11-3719-450b-9bdf-46e61639de0c) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:51 user nova-compute[75288]: INFO os_vif [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=16999ac2-b068-479b-a705-8342b29addc7,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16999ac2-b0')
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDOdRbeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:52:51 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] No VIF found with MAC fa:16:3e:81:41:97, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b24a9-1a09-4cf4-be3e-c0e1375aae11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:52:51 user nova-compute[75288]: No targets found.
Nov 10 22:52:51 user nova-compute[75288]: iSNS:
Nov 10 22:52:51 user nova-compute[75288]: No targets found.
Nov 10 22:52:51 user nova-compute[75288]: STATIC:
Nov 10 22:52:51 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef
Nov 10 22:52:51 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:52:51 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:52:51 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9
Nov 10 22:52:51 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:52:51 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:52:51 user nova-compute[75288]: FIRMWARE:
Nov 10 22:52:51 user nova-compute[75288]: No targets found.
Nov 10 22:52:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:52:51 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:52:51 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a558a9e4-1087-40a8-80dd-f75e992533c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be1fd6-d2d9-40f0-a810-9f7d1318d1a1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:52:51 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:52:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef (non-flash)
Nov 10 22:52:51 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:52:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10355750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34a4156-0830-44c1-8394-df13bf516a47]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[12943c23-7eae-4e00-a84e-3ff59bde2e77]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f40ded6-2438-4d2b-bfc5-d6cb818842e4]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5607c6-70f1-4094-bcd5-434e0a3b593d]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd9274f0-b656-498d-aa74-b0c95631093d tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 85.914s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e3d6e-c9e0-4363-a392-92af91be3630]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a23b56-e5ad-43ff-b68e-66d523470cf2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260]
Nov 10 22:52:52 user nova-compute[75288]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef, portal: 172.16.0.220,3260] successful.
Nov 10 22:52:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a82a0b8-c74b-4bf1-909a-6350439bb7ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3194c20-d723-4eee-bd89-83fe36df62a3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] <== disconnect_volume: return (329ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:52:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Deleting instance files /opt/stack/data/nova/instances/b1a7d533-cad6-4360-b6c4-f12c6fc473a8_del
Nov 10 22:52:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Deletion of /opt/stack/data/nova/instances/b1a7d533-cad6-4360-b6c4-f12c6fc473a8_del complete
Nov 10 22:52:52 user nova-compute[75288]: INFO nova.compute.manager [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-a164225e-5ba1-4eb2-aa12-39f0a7743528 req-ade57207-af86-4c24-87e7-f5a6f2617245 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a164225e-5ba1-4eb2-aa12-39f0a7743528 req-ade57207-af86-4c24-87e7-f5a6f2617245 service nova] Acquiring lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a164225e-5ba1-4eb2-aa12-39f0a7743528 req-ade57207-af86-4c24-87e7-f5a6f2617245 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a164225e-5ba1-4eb2-aa12-39f0a7743528 req-ade57207-af86-4c24-87e7-f5a6f2617245 service nova] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:52:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-a164225e-5ba1-4eb2-aa12-39f0a7743528 req-ade57207-af86-4c24-87e7-f5a6f2617245 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] No waiting events found dispatching network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:52:52 user nova-compute[75288]: WARNING nova.compute.manager [req-a164225e-5ba1-4eb2-aa12-39f0a7743528 req-ade57207-af86-4c24-87e7-f5a6f2617245 service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received unexpected event network-vif-plugged-16999ac2-b068-479b-a705-8342b29addc7 for instance with vm_state active and task_state deleting.
Nov 10 22:52:53 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:52:53 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Took 1.19 seconds to deallocate network for instance.
Nov 10 22:52:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:52:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:52:54 user nova-compute[75288]: INFO nova.compute.manager [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Detaching volume 23d7ee32-0933-4358-adc4-648c5dbdfbe9
Nov 10 22:52:54 user nova-compute[75288]: INFO nova.virt.block_device [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Attempting to driver detach volume 23d7ee32-0933-4358-adc4-648c5dbdfbe9 from mountpoint /dev/vdb
Nov 10 22:52:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Attempting to detach device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:52:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:52:54 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:52:54 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:52:54 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:52:54 user nova-compute[75288]:   <serial>23d7ee32-0933-4358-adc4-648c5dbdfbe9</serial>
Nov 10 22:52:54 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:52:54 user nova-compute[75288]: </disk>
Nov 10 22:52:54 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:52:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the persistent domain config.
Nov 10 22:52:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:52:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:52:54 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:52:54 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:52:54 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:52:54 user nova-compute[75288]:   <serial>23d7ee32-0933-4358-adc4-648c5dbdfbe9</serial>
Nov 10 22:52:54 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:52:54 user nova-compute[75288]: </disk>
Nov 10 22:52:54 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:52:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-1b0d522c-d429-4a98-8823-11c8ae679872 req-b5b41754-e1b6-40e5-805a-0931ef3e40ce service nova] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Received event network-vif-deleted-16999ac2-b068-479b-a705-8342b29addc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:52:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:52:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:52:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:00 user nova-compute[75288]: INFO nova.compute.manager [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Took 7.14 seconds to detach 1 volumes for instance.
Nov 10 22:53:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: b1a7d533-cad6-4360-b6c4-f12c6fc473a8] Deleting volume: 6a82a0b8-c74b-4bf1-909a-6350439bb7ef {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 22:53:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:53:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:53:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:00 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Deleted allocations for instance b1a7d533-cad6-4360-b6c4-f12c6fc473a8
Nov 10 22:53:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7f04d9f3-9001-459a-beb7-a13c50e826fa tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "b1a7d533-cad6-4360-b6c4-f12c6fc473a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.533s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:53:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:53:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:53:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXxDqcMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:53:12 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:53:12 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:53:12 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[262c658a-1b30-41a8-a9dd-e2b79df63ea3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:53:12 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[547aa0e6-0161-418e-b80f-7b0742386b52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1] added
Nov 10 22:53:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97780e0d-0b27-44ac-83ae-4c97d8a95c57]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2fc397-56bb-497d-81c7-3e0d259a2316]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXxDqcMP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LXxDqcMP" returned: 0 in 0.035s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e350ae5c-9f9b-46da-9632-91443f1dccf4]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LXxDqcMP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[905bc26a-dc27-4ef1-8d3b-65d38d3fd42b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6e0ef7-8014-436b-8e3e-63e8b1ae07d8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:53:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:53:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1f6122-c6d5-4b82-9412-51db9d61df88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260]
Nov 10 22:53:13 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260] successful.
Nov 10 22:53:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b8c19-c11d-4d9c-b9d6-a5dff23031fe]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da574e7b-0efc-45a4-9f0f-667e4633d4de]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:53:13 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)
Nov 10 22:53:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:53:13 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)
Nov 10 22:53:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d61cc-dfc3-4873-a3d6-f7f675ba2509]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:53:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXxDqcMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing instance network info cache due to event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23838373066353539', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838373066353539', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lazy-loading 'flavor' on Instance uuid 0f78309d-5e39-4a65-a375-96f43b4ad21f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:53:14 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:53:14 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:53:14 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:53:14 user nova-compute[75288]:   <serial>7b281cd3-5e2e-4011-b7bb-163512a070b1</serial>
Nov 10 22:53:14 user nova-compute[75288]: </disk>
Nov 10 22:53:14 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updated VIF entry in instance network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b13bdea-891f-460a-b7ad-9e5418786112 req-cc9d60c5-bd7e-495e-b326-61b810cb903c service nova] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:53:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] No VIF found with MAC fa:16:3e:c0:f8:a3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b1efeb8-6d91-4b21-bda3-1fcc2ab3d3bd tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.975s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 is timed out.
Nov 10 22:53:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully detached device vdb from instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 from the live domain config.
Nov 10 22:53:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMeRfIXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:53:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3365e73e-bcdf-49c9-a7f2-5adedcb3ccb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:53:15 user nova-compute[75288]: No targets found.
Nov 10 22:53:15 user nova-compute[75288]: iSNS:
Nov 10 22:53:15 user nova-compute[75288]: No targets found.
Nov 10 22:53:15 user nova-compute[75288]: STATIC:
Nov 10 22:53:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1
Nov 10 22:53:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:53:15 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:53:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9
Nov 10 22:53:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:53:15 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:53:15 user nova-compute[75288]: FIRMWARE:
Nov 10 22:53:15 user nova-compute[75288]: No targets found.
Nov 10 22:53:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:53:15 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:53:15 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[95396e90-46a4-445a-862a-8fde204c8d17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c8c8f-31dc-45fd-8725-867b9e374587]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:53:15 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)
Nov 10 22:53:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 (non-flash)
Nov 10 22:53:15 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)
Nov 10 22:53:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b103a3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e874cde-ba63-45f5-9e3a-ae0ad7158d2b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: INFO nova.compute.manager [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] instance snapshotting
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f706b-4120-45a7-bb94-5588cec5cc7e]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f1a41c-4d76-4a47-a23e-33cc67a2aa8d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce90ac5-09ad-4c1a-8d2d-273f1572c6fd]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Beginning live snapshot process
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[503750f7-08e4-4e15-9f4f-49aef5df3ae8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[635216fb-58fc-4a46-93dc-225f62a0b789]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260]
Nov 10 22:53:15 user nova-compute[75288]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9, portal: 172.16.0.220,3260] successful.
Nov 10 22:53:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d7ee32-0933-4358-adc4-648c5dbdfbe9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24e74a-72e7-401b-8a24-aa87f4585d70]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] <== disconnect_volume: return (353ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.238s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpclupf975/5e784a9242974208b6874f3b5d50826f.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpclupf975/5e784a9242974208b6874f3b5d50826f.delta 1073741824" returned: 0 in 0.059s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 22:53:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'flavor' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:53:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e327c761-8574-44b5-9087-40702d66c8ad tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.277s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:17 user nova-compute[75288]: INFO nova.compute.manager [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Detaching volume 7b281cd3-5e2e-4011-b7bb-163512a070b1
Nov 10 22:53:17 user nova-compute[75288]: INFO nova.virt.block_device [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Attempting to driver detach volume 7b281cd3-5e2e-4011-b7bb-163512a070b1 from mountpoint /dev/vdb
Nov 10 22:53:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Attempting to detach device vdb from instance 0f78309d-5e39-4a65-a375-96f43b4ad21f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:53:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:53:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:53:17 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:53:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:53:17 user nova-compute[75288]:   <serial>7b281cd3-5e2e-4011-b7bb-163512a070b1</serial>
Nov 10 22:53:17 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:53:17 user nova-compute[75288]: </disk>
Nov 10 22:53:17 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:53:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Successfully detached device vdb from instance 0f78309d-5e39-4a65-a375-96f43b4ad21f from the persistent domain config.
Nov 10 22:53:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f78309d-5e39-4a65-a375-96f43b4ad21f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:53:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:53:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:53:17 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:53:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:53:17 user nova-compute[75288]:   <serial>7b281cd3-5e2e-4011-b7bb-163512a070b1</serial>
Nov 10 22:53:17 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:53:17 user nova-compute[75288]: </disk>
Nov 10 22:53:17 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:53:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:53:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] COPY block job progress, current cursor: 3014656 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:53:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f78309d-5e39-4a65-a375-96f43b4ad21f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:53:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 22:53:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 22:53:18 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:53:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpclupf975/5e784a9242974208b6874f3b5d50826f.delta /opt/stack/data/nova/instances/snapshots/tmpclupf975/5e784a9242974208b6874f3b5d50826f {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpclupf975/5e784a9242974208b6874f3b5d50826f.delta /opt/stack/data/nova/instances/snapshots/tmpclupf975/5e784a9242974208b6874f3b5d50826f" returned: 0 in 0.443s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Snapshot extracted, beginning image upload
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "451fa08f-beb7-4723-8b2f-e917421a2763" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "451fa08f-beb7-4723-8b2f-e917421a2763" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:53:21 user nova-compute[75288]: INFO nova.compute.claims [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Claim successful on node user
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:53:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.policy [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ae6d9a8144d486182a72c54615ce1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6def6603ae64b19be3fab36555a02d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:53:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Creating image(s)
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "/opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "/opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "/opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.228s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk 1073741824" returned: 0 in 0.068s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Snapshot image upload complete
Nov 10 22:53:22 user nova-compute[75288]: INFO nova.compute.manager [None req-08062a1d-2d54-4208-a2a9-420c0cb647a8 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Took 6.96 seconds to snapshot the instance on the hypervisor.
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.234s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Successfully created port: caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Cannot resize image /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Ensure instance console log exists: /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Successfully updated port: caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "refresh_cache-451fa08f-beb7-4723-8b2f-e917421a2763" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquired lock "refresh_cache-451fa08f-beb7-4723-8b2f-e917421a2763" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received event network-changed-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Refreshing instance network info cache due to event network-changed-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] Acquiring lock "refresh_cache-451fa08f-beb7-4723-8b2f-e917421a2763" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Updating instance_info_cache with network_info: [{"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Releasing lock "refresh_cache-451fa08f-beb7-4723-8b2f-e917421a2763" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Instance network_info: |[{"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] Acquired lock "refresh_cache-451fa08f-beb7-4723-8b2f-e917421a2763" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Refreshing network info cache for port caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Start _get_guest_xml network_info=[{"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:53:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:53:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1780652658',display_name='tempest-VolumesNegativeTest-instance-1780652658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1780652658',id=32,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6def6603ae64b19be3fab36555a02d6',ramdisk_id='',reservation_id='r-q9xjqxvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1031338598',owner_user_name='tempest-VolumesNegativeTest-1031338598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:53:22Z,user_data=None,user_id='1ae6d9a8144d486182a72c54615ce1ae',uuid=451fa08f-beb7-4723-8b2f-e917421a2763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Converting VIF {"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65,network=Network(251955df-0500-461a-9bf7-b6cae3c9e602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa73e1f-5c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lazy-loading 'pci_devices' on Instance uuid 451fa08f-beb7-4723-8b2f-e917421a2763 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:53:23 user nova-compute[75288]:   <uuid>451fa08f-beb7-4723-8b2f-e917421a2763</uuid>
Nov 10 22:53:23 user nova-compute[75288]:   <name>instance-00000020</name>
Nov 10 22:53:23 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:53:23 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:53:23 user nova-compute[75288]:   <metadata>
Nov 10 22:53:23 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:53:23 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:53:23 user nova-compute[75288]:       <nova:name>tempest-VolumesNegativeTest-instance-1780652658</nova:name>
Nov 10 22:53:23 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:53:23</nova:creationTime>
Nov 10 22:53:23 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:53:23 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:53:23 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:53:23 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:53:23 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:53:23 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:53:23 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:53:23 user nova-compute[75288]:       <nova:owner>
Nov 10 22:53:23 user nova-compute[75288]:         <nova:user uuid="1ae6d9a8144d486182a72c54615ce1ae">tempest-VolumesNegativeTest-1031338598-project-member</nova:user>
Nov 10 22:53:23 user nova-compute[75288]:         <nova:project uuid="f6def6603ae64b19be3fab36555a02d6">tempest-VolumesNegativeTest-1031338598</nova:project>
Nov 10 22:53:23 user nova-compute[75288]:       </nova:owner>
Nov 10 22:53:23 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:53:23 user nova-compute[75288]:       <nova:ports>
Nov 10 22:53:23 user nova-compute[75288]:         <nova:port uuid="caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65">
Nov 10 22:53:23 user nova-compute[75288]:           <nova:ip type="fixed" address="192.168.233.141" ipVersion="4"/>
Nov 10 22:53:23 user nova-compute[75288]:         </nova:port>
Nov 10 22:53:23 user nova-compute[75288]:       </nova:ports>
Nov 10 22:53:23 user nova-compute[75288]:     </nova:instance>
Nov 10 22:53:23 user nova-compute[75288]:   </metadata>
Nov 10 22:53:23 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:53:23 user nova-compute[75288]:     <system>
Nov 10 22:53:23 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:53:23 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:53:23 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:53:23 user nova-compute[75288]:       <entry name="serial">451fa08f-beb7-4723-8b2f-e917421a2763</entry>
Nov 10 22:53:23 user nova-compute[75288]:       <entry name="uuid">451fa08f-beb7-4723-8b2f-e917421a2763</entry>
Nov 10 22:53:23 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:53:23 user nova-compute[75288]:     </system>
Nov 10 22:53:23 user nova-compute[75288]:   </sysinfo>
Nov 10 22:53:23 user nova-compute[75288]:   <os>
Nov 10 22:53:23 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:53:23 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:53:23 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:53:23 user nova-compute[75288]:   </os>
Nov 10 22:53:23 user nova-compute[75288]:   <features>
Nov 10 22:53:23 user nova-compute[75288]:     <acpi/>
Nov 10 22:53:23 user nova-compute[75288]:     <apic/>
Nov 10 22:53:23 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:53:23 user nova-compute[75288]:   </features>
Nov 10 22:53:23 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:53:23 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:53:23 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:53:23 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:53:23 user nova-compute[75288]:   </clock>
Nov 10 22:53:23 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:53:23 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:53:23 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:53:23 user nova-compute[75288]:   </cpu>
Nov 10 22:53:23 user nova-compute[75288]:   <devices>
Nov 10 22:53:23 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:53:23 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:53:23 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk"/>
Nov 10 22:53:23 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:53:23 user nova-compute[75288]:     </disk>
Nov 10 22:53:23 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:53:23 user nova-compute[75288]:       <mac address="fa:16:3e:55:3d:03"/>
Nov 10 22:53:23 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:53:23 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:53:23 user nova-compute[75288]:       <target dev="tapcaa73e1f-5c"/>
Nov 10 22:53:23 user nova-compute[75288]:     </interface>
Nov 10 22:53:23 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:53:23 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/console.log" append="off"/>
Nov 10 22:53:23 user nova-compute[75288]:     </serial>
Nov 10 22:53:23 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:53:23 user nova-compute[75288]:     <video>
Nov 10 22:53:23 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:53:23 user nova-compute[75288]:     </video>
Nov 10 22:53:23 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:53:23 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:53:23 user nova-compute[75288]:     </rng>
Nov 10 22:53:23 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:53:23 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:53:23 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:53:23 user nova-compute[75288]:     </memballoon>
Nov 10 22:53:23 user nova-compute[75288]:   </devices>
Nov 10 22:53:23 user nova-compute[75288]: </domain>
Nov 10 22:53:23 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1780652658',display_name='tempest-VolumesNegativeTest-instance-1780652658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1780652658',id=32,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6def6603ae64b19be3fab36555a02d6',ramdisk_id='',reservation_id='r-q9xjqxvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1031338598',owner_user_name='tempest-VolumesNegativeTest-1031338598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:53:22Z,user_data=None,user_id='1ae6d9a8144d486182a72c54615ce1ae',uuid=451fa08f-beb7-4723-8b2f-e917421a2763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Converting VIF {"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65,network=Network(251955df-0500-461a-9bf7-b6cae3c9e602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa73e1f-5c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG os_vif [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65,network=Network(251955df-0500-461a-9bf7-b6cae3c9e602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa73e1f-5c') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9730031c-9308-51df-9c62-56737fd57036', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaa73e1f-5c, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcaa73e1f-5c, col_values=(('qos', UUID('933b258b-ad6b-4be7-86b1-d45e3211bf6f')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcaa73e1f-5c, col_values=(('external_ids', {'iface-id': 'caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:3d:03', 'vm-uuid': '451fa08f-beb7-4723-8b2f-e917421a2763'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:24 user nova-compute[75288]: INFO os_vif [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65,network=Network(251955df-0500-461a-9bf7-b6cae3c9e602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa73e1f-5c')
Nov 10 22:53:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] No VIF found with MAC fa:16:3e:55:3d:03, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Updated VIF entry in instance network info cache for port caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Updating instance_info_cache with network_info: [{"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:53:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9b192ca-e19a-4987-a206-adaefd8228f0 req-b020b1eb-e7c1-46a0-a623-221b723eee10 service nova] Releasing lock "refresh_cache-451fa08f-beb7-4723-8b2f-e917421a2763" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-860970c7-0b0e-4af2-99c5-80f5256c0534 req-83ba04a9-3bfd-4f13-8b34-9611677d0e5d service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received event network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-860970c7-0b0e-4af2-99c5-80f5256c0534 req-83ba04a9-3bfd-4f13-8b34-9611677d0e5d service nova] Acquiring lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-860970c7-0b0e-4af2-99c5-80f5256c0534 req-83ba04a9-3bfd-4f13-8b34-9611677d0e5d service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-860970c7-0b0e-4af2-99c5-80f5256c0534 req-83ba04a9-3bfd-4f13-8b34-9611677d0e5d service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-860970c7-0b0e-4af2-99c5-80f5256c0534 req-83ba04a9-3bfd-4f13-8b34-9611677d0e5d service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] No waiting events found dispatching network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:53:25 user nova-compute[75288]: WARNING nova.compute.manager [req-860970c7-0b0e-4af2-99c5-80f5256c0534 req-83ba04a9-3bfd-4f13-8b34-9611677d0e5d service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received unexpected event network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 for instance with vm_state building and task_state spawning.
Nov 10 22:53:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-12424699-c9cd-4e11-bafd-189ce5ee58d8 req-2fcf2363-d983-44e1-9160-ab103534bfbc service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received event network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12424699-c9cd-4e11-bafd-189ce5ee58d8 req-2fcf2363-d983-44e1-9160-ab103534bfbc service nova] Acquiring lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12424699-c9cd-4e11-bafd-189ce5ee58d8 req-2fcf2363-d983-44e1-9160-ab103534bfbc service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12424699-c9cd-4e11-bafd-189ce5ee58d8 req-2fcf2363-d983-44e1-9160-ab103534bfbc service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-12424699-c9cd-4e11-bafd-189ce5ee58d8 req-2fcf2363-d983-44e1-9160-ab103534bfbc service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] No waiting events found dispatching network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:53:27 user nova-compute[75288]: WARNING nova.compute.manager [req-12424699-c9cd-4e11-bafd-189ce5ee58d8 req-2fcf2363-d983-44e1-9160-ab103534bfbc service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received unexpected event network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 for instance with vm_state building and task_state spawning.
Nov 10 22:53:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Skipping network cache update for instance because it is Building. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:53:27 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 5f06057c-abec-4ae3-ac9e-2cdede2cad3f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:53:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Instance spawned successfully.
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:53:28 user nova-compute[75288]: INFO nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:53:28 user nova-compute[75288]: INFO nova.compute.manager [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Took 7.17 seconds to build instance.
Nov 10 22:53:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6880b7ea-f1d3-4514-8857-3af2a7fd3aa7 tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "451fa08f-beb7-4723-8b2f-e917421a2763" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.300s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [{"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-5f06057c-abec-4ae3-ac9e-2cdede2cad3f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:53:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:53:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:53:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=25.15471649169922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0f78309d-5e39-4a65-a375-96f43b4ad21f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 451fa08f-beb7-4723-8b2f-e917421a2763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:53:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0f78309d-5e39-4a65-a375-96f43b4ad21f is timed out.
Nov 10 22:53:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Successfully detached device vdb from instance 0f78309d-5e39-4a65-a375-96f43b4ad21f from the live domain config.
Nov 10 22:53:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LXxDqcMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:53:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2a29b0-af3b-4603-9956-4a634eb4cbb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:53:38 user nova-compute[75288]: No targets found.
Nov 10 22:53:38 user nova-compute[75288]: iSNS:
Nov 10 22:53:38 user nova-compute[75288]: No targets found.
Nov 10 22:53:38 user nova-compute[75288]: STATIC:
Nov 10 22:53:38 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1
Nov 10 22:53:38 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:53:38 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:53:38 user nova-compute[75288]: FIRMWARE:
Nov 10 22:53:38 user nova-compute[75288]: No targets found.
Nov 10 22:53:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:53:38 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:53:38 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[51881d4e-e110-4a87-9206-d756c4a16564]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c46ee28-fdda-4c15-87c1-954727880ba0]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)
Nov 10 22:53:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 (non-flash)
Nov 10 22:53:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10354e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9a259d-f1ac-4390-97c9-8457860fbdef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca317a-bfe9-4cec-be52-b740016b141d]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a787c3-1189-4e5f-9b31-d12b5480b6cf]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04388f38-74f3-4f2d-a9fa-eb82ec919cf5]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df24284-bb22-41c8-b192-e912eae247fc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b56a2-3910-4fca-bede-a5e08703b0e2]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260]
Nov 10 22:53:38 user nova-compute[75288]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1, portal: 172.16.0.220,3260] successful.
Nov 10 22:53:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b281cd3-5e2e-4011-b7bb-163512a070b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179b583-16fa-4a72-9944-e104da5a9319]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] <== disconnect_volume: return (322ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:53:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lazy-loading 'flavor' on Instance uuid 0f78309d-5e39-4a65-a375-96f43b4ad21f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8aefbd9c-3d66-4169-9b8f-0f6554af1a1f tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.625s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:55 user nova-compute[75288]: INFO nova.compute.manager [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Terminating instance
Nov 10 22:53:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-31d28efb-7fe4-41ca-808a-d858834ceac1 req-f892f0b5-8668-4a81-9102-6b4cbaa19de1 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-unplugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31d28efb-7fe4-41ca-808a-d858834ceac1 req-f892f0b5-8668-4a81-9102-6b4cbaa19de1 service nova] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31d28efb-7fe4-41ca-808a-d858834ceac1 req-f892f0b5-8668-4a81-9102-6b4cbaa19de1 service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31d28efb-7fe4-41ca-808a-d858834ceac1 req-f892f0b5-8668-4a81-9102-6b4cbaa19de1 service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-31d28efb-7fe4-41ca-808a-d858834ceac1 req-f892f0b5-8668-4a81-9102-6b4cbaa19de1 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] No waiting events found dispatching network-vif-unplugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:53:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-31d28efb-7fe4-41ca-808a-d858834ceac1 req-f892f0b5-8668-4a81-9102-6b4cbaa19de1 service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-unplugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Instance destroyed successfully.
Nov 10 22:53:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lazy-loading 'resources' on Instance uuid 5f06057c-abec-4ae3-ac9e-2cdede2cad3f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1387018457',display_name='tempest-ServerActionsTestOtherA-server-1387018457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1387018457',id=4,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGDRho9FMIIDfKOCi1JTH2BeR2ra7Ufz/PVKVMBMoNwPYK3XDniySQ4613ZZrGibUJOwEYPTAaXV4GI5QdH4wS6v9pqS+Pbr39KoHeV2gejmT6iUWaF26MBWOBvJV8o+Q==',key_name='tempest-keypair-1554947225',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d01027aba7e1424390b507afbad93f23',ramdisk_id='',reservation_id='r-ujuj0lyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1568173136',owner_user_name='tempest-ServerActionsTestOtherA-1568173136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1839c7b8368947ccacf91af8fd6f0faf',uuid=5f06057c-abec-4ae3-ac9e-2cdede2cad3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converting VIF {"id": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "address": "fa:16:3e:6d:6e:67", "network": {"id": "b82839f5-0e85-44de-95dd-75eba8e76725", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-215817591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d01027aba7e1424390b507afbad93f23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66bbdfb-8c", "ovs_interfaceid": "b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:6e:67,bridge_name='br-int',has_traffic_filtering=True,id=b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66bbdfb-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG os_vif [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:6e:67,bridge_name='br-int',has_traffic_filtering=True,id=b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66bbdfb-8c') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb66bbdfb-8c, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e2e67a4-3737-4071-b491-ed2ad353450d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:53:56 user nova-compute[75288]: INFO os_vif [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:6e:67,bridge_name='br-int',has_traffic_filtering=True,id=b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0,network=Network(b82839f5-0e85-44de-95dd-75eba8e76725),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66bbdfb-8c')
Nov 10 22:53:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Deleting instance files /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f_del
Nov 10 22:53:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Deletion of /opt/stack/data/nova/instances/5f06057c-abec-4ae3-ac9e-2cdede2cad3f_del complete
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: INFO nova.compute.manager [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 10 22:53:56 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:53:57 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Took 0.67 seconds to deallocate network for instance.
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:57 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Deleted allocations for instance 5f06057c-abec-4ae3-ac9e-2cdede2cad3f
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-99921865-e38f-4c5e-bb5e-495d2fc1cbdf tempest-ServerActionsTestOtherA-1568173136 tempest-ServerActionsTestOtherA-1568173136-project-member] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] No waiting events found dispatching network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:53:57 user nova-compute[75288]: WARNING nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received unexpected event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 for instance with vm_state deleted and task_state None.
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] No waiting events found dispatching network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:53:57 user nova-compute[75288]: WARNING nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received unexpected event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 for instance with vm_state deleted and task_state None.
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Acquiring lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] Lock "5f06057c-abec-4ae3-ac9e-2cdede2cad3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] No waiting events found dispatching network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:53:57 user nova-compute[75288]: WARNING nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received unexpected event network-vif-plugged-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 for instance with vm_state deleted and task_state None.
Nov 10 22:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-165d2df2-d940-4e6b-bed9-aea3eb5aa79e req-7a0a3578-6bda-4e1c-abfb-cb76210dd01f service nova] [instance: 5f06057c-abec-4ae3-ac9e-2cdede2cad3f] Received event network-vif-deleted-b66bbdfb-8cc2-4fe5-bdbe-0c802da8faf0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:53:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:20 user nova-compute[75288]: INFO nova.compute.manager [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Terminating instance
Nov 10 22:54:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:54:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Instance destroyed successfully.
Nov 10 22:54:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lazy-loading 'resources' on Instance uuid 0f78309d-5e39-4a65-a375-96f43b4ad21f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410868930',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410868930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1410868',id=30,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxFFSvYwLciXmQXBa1MZQE2gSHiFbL6PI8/wRUfpu9m8fbMDcl+cf2W1prbmWF0AW8c9wBuqefy4to/iqcgcie5twtE01cEcJjFRYigCqISppuQLAJmHhODfUf/CwJPrA==',key_name='tempest-keypair-1452670727',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fa1cd0b367844798543f77845cda352',ramdisk_id='',reservation_id='r-a854hlg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-94576300',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db25e1cfa98c4bdea7c28dd848a81781',uuid=0f78309d-5e39-4a65-a375-96f43b4ad21f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Converting VIF {"id": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "address": "fa:16:3e:c0:f8:a3", "network": {"id": "3788b6a8-29e7-4e09-aca9-d9a7560d266a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1325683687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa1cd0b367844798543f77845cda352", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b0d0abf-11", "ovs_interfaceid": "6b0d0abf-11e1-45c0-80f8-8c77f0a3d720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:f8:a3,bridge_name='br-int',has_traffic_filtering=True,id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720,network=Network(3788b6a8-29e7-4e09-aca9-d9a7560d266a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0d0abf-11') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG os_vif [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:f8:a3,bridge_name='br-int',has_traffic_filtering=True,id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720,network=Network(3788b6a8-29e7-4e09-aca9-d9a7560d266a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0d0abf-11') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b0d0abf-11, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c210e774-5582-4901-b5d1-85d08fba362b) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:54:21 user nova-compute[75288]: INFO os_vif [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:f8:a3,bridge_name='br-int',has_traffic_filtering=True,id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720,network=Network(3788b6a8-29e7-4e09-aca9-d9a7560d266a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b0d0abf-11')
Nov 10 22:54:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Deleting instance files /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f_del
Nov 10 22:54:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Deletion of /opt/stack/data/nova/instances/0f78309d-5e39-4a65-a375-96f43b4ad21f_del complete
Nov 10 22:54:21 user nova-compute[75288]: INFO nova.compute.manager [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 22:54:21 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:54:21 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:54:22 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Took 0.79 seconds to deallocate network for instance.
Nov 10 22:54:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c1bf6460-b4aa-46ee-98ab-95a67da77273 req-8abbe56f-a542-4439-89fb-12c54f202ee0 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Received event network-vif-deleted-6b0d0abf-11e1-45c0-80f8-8c77f0a3d720 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:22 user nova-compute[75288]: INFO nova.compute.manager [req-c1bf6460-b4aa-46ee-98ab-95a67da77273 req-8abbe56f-a542-4439-89fb-12c54f202ee0 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Neutron deleted interface 6b0d0abf-11e1-45c0-80f8-8c77f0a3d720; detaching it from the instance and deleting it from the info cache
Nov 10 22:54:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-c1bf6460-b4aa-46ee-98ab-95a67da77273 req-8abbe56f-a542-4439-89fb-12c54f202ee0 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c1bf6460-b4aa-46ee-98ab-95a67da77273 req-8abbe56f-a542-4439-89fb-12c54f202ee0 service nova] [instance: 0f78309d-5e39-4a65-a375-96f43b4ad21f] Detach interface failed, port_id=6b0d0abf-11e1-45c0-80f8-8c77f0a3d720, reason: Instance 0f78309d-5e39-4a65-a375-96f43b4ad21f could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:54:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:54:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:23 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Deleted allocations for instance 0f78309d-5e39-4a65-a375-96f43b4ad21f
Nov 10 22:54:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-09eed7de-6156-46be-b6ce-e4a1dfffd3b7 tempest-TestServerVolumeAttachScenarioOldVersion-94576300 tempest-TestServerVolumeAttachScenarioOldVersion-94576300-project-member] Lock "0f78309d-5e39-4a65-a375-96f43b4ad21f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:54:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:54:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:54:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating instance_info_cache with network_info: [{"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-d47e90fb-6b83-4b5e-98dd-3c6e86951006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:54:29 user nova-compute[75288]: INFO nova.compute.claims [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Claim successful on node user
Nov 10 22:54:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:54:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:54:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.policy [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86919732056405e8f8da616270f2672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0485db81ce8748b1b2bf3b8e907cdc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:54:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Creating image(s)
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "/opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "/opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "/opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "51717fb9b5b1101b4f645471ef135a04d3fe7805" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "51717fb9b5b1101b4f645471ef135a04d3fe7805" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Successfully created port: 8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG nova.virt.images [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] e308fd24-621c-4d7b-86e9-9d9c313386b0 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.part /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.part /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.converted" returned: 0 in 0.324s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "51717fb9b5b1101b4f645471ef135a04d3fe7805" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.235s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "51717fb9b5b1101b4f645471ef135a04d3fe7805" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "51717fb9b5b1101b4f645471ef135a04d3fe7805" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Successfully updated port: 8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquired lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing instance network info cache due to event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] Acquiring lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805,backing_fmt=raw /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805,backing_fmt=raw /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk 1073741824" returned: 0 in 0.136s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "51717fb9b5b1101b4f645471ef135a04d3fe7805" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.306s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Releasing lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance network_info: |[{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] Acquired lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Cannot resize image /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Ensure instance console log exists: /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Start _get_guest_xml network_info=[{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:54:26Z,direct_url=<?>,disk_format='qcow2',id=e308fd24-621c-4d7b-86e9-9d9c313386b0,min_disk=0,min_ram=0,name='tempest-scenario-img--448078579',owner='0485db81ce8748b1b2bf3b8e907cdc5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:54:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'e308fd24-621c-4d7b-86e9-9d9c313386b0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:54:32 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:54:32 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:54:26Z,direct_url=<?>,disk_format='qcow2',id=e308fd24-621c-4d7b-86e9-9d9c313386b0,min_disk=0,min_ram=0,name='tempest-scenario-img--448078579',owner='0485db81ce8748b1b2bf3b8e907cdc5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:54:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-707260519',display_name='tempest-TestMinimumBasicScenario-server-707260519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-707260519',id=33,image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAnycqgamJwND3ivFUe2jrg9RcTBb7FqWtujrWk9V0BByF54ALcpf7Ow0h3nUkotkz/DSyNhh4DzVfVP+E248pNersZ8Xnr3f9sUZnvgnpL84DE4/3hM1icjyay/OSXNQ==',key_name='tempest-TestMinimumBasicScenario-817919814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-z5nhbbqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:54:30Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=60307487-1cfc-412f-86c8-994b8d9b47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'pci_devices' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:54:32 user nova-compute[75288]:   <uuid>60307487-1cfc-412f-86c8-994b8d9b47db</uuid>
Nov 10 22:54:32 user nova-compute[75288]:   <name>instance-00000021</name>
Nov 10 22:54:32 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:54:32 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:54:32 user nova-compute[75288]:   <metadata>
Nov 10 22:54:32 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:54:32 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:54:32 user nova-compute[75288]:       <nova:name>tempest-TestMinimumBasicScenario-server-707260519</nova:name>
Nov 10 22:54:32 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:54:32</nova:creationTime>
Nov 10 22:54:32 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:54:32 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:54:32 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:54:32 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:54:32 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:54:32 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:54:32 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:54:32 user nova-compute[75288]:       <nova:owner>
Nov 10 22:54:32 user nova-compute[75288]:         <nova:user uuid="f86919732056405e8f8da616270f2672">tempest-TestMinimumBasicScenario-519527003-project-member</nova:user>
Nov 10 22:54:32 user nova-compute[75288]:         <nova:project uuid="0485db81ce8748b1b2bf3b8e907cdc5a">tempest-TestMinimumBasicScenario-519527003</nova:project>
Nov 10 22:54:32 user nova-compute[75288]:       </nova:owner>
Nov 10 22:54:32 user nova-compute[75288]:       <nova:root type="image" uuid="e308fd24-621c-4d7b-86e9-9d9c313386b0"/>
Nov 10 22:54:32 user nova-compute[75288]:       <nova:ports>
Nov 10 22:54:32 user nova-compute[75288]:         <nova:port uuid="8608898a-9485-46c2-9f58-d8aaf19f2ad3">
Nov 10 22:54:32 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 22:54:32 user nova-compute[75288]:         </nova:port>
Nov 10 22:54:32 user nova-compute[75288]:       </nova:ports>
Nov 10 22:54:32 user nova-compute[75288]:     </nova:instance>
Nov 10 22:54:32 user nova-compute[75288]:   </metadata>
Nov 10 22:54:32 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:54:32 user nova-compute[75288]:     <system>
Nov 10 22:54:32 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:54:32 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:54:32 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:54:32 user nova-compute[75288]:       <entry name="serial">60307487-1cfc-412f-86c8-994b8d9b47db</entry>
Nov 10 22:54:32 user nova-compute[75288]:       <entry name="uuid">60307487-1cfc-412f-86c8-994b8d9b47db</entry>
Nov 10 22:54:32 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:54:32 user nova-compute[75288]:     </system>
Nov 10 22:54:32 user nova-compute[75288]:   </sysinfo>
Nov 10 22:54:32 user nova-compute[75288]:   <os>
Nov 10 22:54:32 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:54:32 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:54:32 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:54:32 user nova-compute[75288]:   </os>
Nov 10 22:54:32 user nova-compute[75288]:   <features>
Nov 10 22:54:32 user nova-compute[75288]:     <acpi/>
Nov 10 22:54:32 user nova-compute[75288]:     <apic/>
Nov 10 22:54:32 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:54:32 user nova-compute[75288]:   </features>
Nov 10 22:54:32 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:54:32 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:54:32 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:54:32 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:54:32 user nova-compute[75288]:   </clock>
Nov 10 22:54:32 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:54:32 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:54:32 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:54:32 user nova-compute[75288]:   </cpu>
Nov 10 22:54:32 user nova-compute[75288]:   <devices>
Nov 10 22:54:32 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:54:32 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:54:32 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk"/>
Nov 10 22:54:32 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:54:32 user nova-compute[75288]:     </disk>
Nov 10 22:54:32 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:54:32 user nova-compute[75288]:       <mac address="fa:16:3e:b9:50:33"/>
Nov 10 22:54:32 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:54:32 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:54:32 user nova-compute[75288]:       <target dev="tap8608898a-94"/>
Nov 10 22:54:32 user nova-compute[75288]:     </interface>
Nov 10 22:54:32 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:54:32 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/console.log" append="off"/>
Nov 10 22:54:32 user nova-compute[75288]:     </serial>
Nov 10 22:54:32 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:54:32 user nova-compute[75288]:     <video>
Nov 10 22:54:32 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:54:32 user nova-compute[75288]:     </video>
Nov 10 22:54:32 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:54:32 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:54:32 user nova-compute[75288]:     </rng>
Nov 10 22:54:32 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:54:32 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:54:32 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:54:32 user nova-compute[75288]:     </memballoon>
Nov 10 22:54:32 user nova-compute[75288]:   </devices>
Nov 10 22:54:32 user nova-compute[75288]: </domain>
Nov 10 22:54:32 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-707260519',display_name='tempest-TestMinimumBasicScenario-server-707260519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-707260519',id=33,image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAnycqgamJwND3ivFUe2jrg9RcTBb7FqWtujrWk9V0BByF54ALcpf7Ow0h3nUkotkz/DSyNhh4DzVfVP+E248pNersZ8Xnr3f9sUZnvgnpL84DE4/3hM1icjyay/OSXNQ==',key_name='tempest-TestMinimumBasicScenario-817919814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-z5nhbbqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:54:30Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=60307487-1cfc-412f-86c8-994b8d9b47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG os_vif [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5e5d75b-f6c6-5634-b342-07eb108621ee', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8608898a-94, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8608898a-94, col_values=(('qos', UUID('33e1cb5b-87e7-4bf5-9714-bce334b61063')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8608898a-94, col_values=(('external_ids', {'iface-id': '8608898a-9485-46c2-9f58-d8aaf19f2ad3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:50:33', 'vm-uuid': '60307487-1cfc-412f-86c8-994b8d9b47db'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:32 user nova-compute[75288]: INFO os_vif [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94')
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No VIF found with MAC fa:16:3e:b9:50:33, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updated VIF entry in instance network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4116a613-c5ac-42f6-9561-dac89c75e622 req-546aa81c-e734-450b-b2b1-798bdd0dd825 service nova] Releasing lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-96cbc88c-e4d6-4cea-953b-d61664e3c987 req-140011b6-0b82-494b-be4b-f297859eab5b service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-96cbc88c-e4d6-4cea-953b-d61664e3c987 req-140011b6-0b82-494b-be4b-f297859eab5b service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-96cbc88c-e4d6-4cea-953b-d61664e3c987 req-140011b6-0b82-494b-be4b-f297859eab5b service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-96cbc88c-e4d6-4cea-953b-d61664e3c987 req-140011b6-0b82-494b-be4b-f297859eab5b service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-96cbc88c-e4d6-4cea-953b-d61664e3c987 req-140011b6-0b82-494b-be4b-f297859eab5b service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:54:36 user nova-compute[75288]: WARNING nova.compute.manager [req-96cbc88c-e4d6-4cea-953b-d61664e3c987 req-140011b6-0b82-494b-be4b-f297859eab5b service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received unexpected event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with vm_state building and task_state spawning.
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-b595e1c5-ada1-47d6-9350-f08cc3127b35 req-22e50ae0-1996-4974-9ddc-f53ca98e1a53 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b595e1c5-ada1-47d6-9350-f08cc3127b35 req-22e50ae0-1996-4974-9ddc-f53ca98e1a53 service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b595e1c5-ada1-47d6-9350-f08cc3127b35 req-22e50ae0-1996-4974-9ddc-f53ca98e1a53 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b595e1c5-ada1-47d6-9350-f08cc3127b35 req-22e50ae0-1996-4974-9ddc-f53ca98e1a53 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-b595e1c5-ada1-47d6-9350-f08cc3127b35 req-22e50ae0-1996-4974-9ddc-f53ca98e1a53 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:54:36 user nova-compute[75288]: WARNING nova.compute.manager [req-b595e1c5-ada1-47d6-9350-f08cc3127b35 req-22e50ae0-1996-4974-9ddc-f53ca98e1a53 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received unexpected event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with vm_state building and task_state spawning.
Nov 10 22:54:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance spawned successfully.
Nov 10 22:54:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:54:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8145MB free_disk=25.09282684326172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:54:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 451fa08f-beb7-4723-8b2f-e917421a2763 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 60307487-1cfc-412f-86c8-994b8d9b47db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:54:37 user nova-compute[75288]: INFO nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:54:37 user nova-compute[75288]: INFO nova.compute.manager [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Took 7.47 seconds to build instance.
Nov 10 22:54:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cf2702b7-e5cc-4215-be73-d0b0537f9bad tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.578s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:54:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:45 user nova-compute[75288]: INFO nova.compute.manager [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Rescuing
Nov 10 22:54:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:54:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:54:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:54:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:54:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:54:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:54:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance destroyed successfully.
Nov 10 22:54:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Attempting rescue
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 22:54:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Creating image(s)
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-9e6ddd2b-7dd2-42ec-b83f-8fe799c2217a req-77b16d8b-59e1-4b32-9b20-9fdaa03369f0 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9e6ddd2b-7dd2-42ec-b83f-8fe799c2217a req-77b16d8b-59e1-4b32-9b20-9fdaa03369f0 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9e6ddd2b-7dd2-42ec-b83f-8fe799c2217a req-77b16d8b-59e1-4b32-9b20-9fdaa03369f0 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9e6ddd2b-7dd2-42ec-b83f-8fe799c2217a req-77b16d8b-59e1-4b32-9b20-9fdaa03369f0 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-9e6ddd2b-7dd2-42ec-b83f-8fe799c2217a req-77b16d8b-59e1-4b32-9b20-9fdaa03369f0 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:54:47 user nova-compute[75288]: WARNING nova.compute.manager [req-9e6ddd2b-7dd2-42ec-b83f-8fe799c2217a req-77b16d8b-59e1-4b32-9b20-9fdaa03369f0 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state active and task_state rescuing.
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue" returned: 0 in 0.059s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'migration_context' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<0c73ba31-10a8-483a-9fcc-fe0beeeffba8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Start _get_guest_xml network_info=[{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:04:76:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'resources' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<0c73ba31-10a8-483a-9fcc-fe0beeeffba8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<0c73ba31-10a8-483a-9fcc-fe0beeeffba8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:54:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:54:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:54:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<0c73ba31-10a8-483a-9fcc-fe0beeeffba8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449796295',display_name='tempest-ServerRescueNegativeTestJSON-server-449796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-449796295',id=28,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:50:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-jfvj441o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:50:07Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=0c73ba31-10a8-483a-9fcc-fe0beeeffba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:04:76:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:04:76:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<0c73ba31-10a8-483a-9fcc-fe0beeeffba8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:54:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:54:47 user nova-compute[75288]:   <uuid>0c73ba31-10a8-483a-9fcc-fe0beeeffba8</uuid>
Nov 10 22:54:47 user nova-compute[75288]:   <name>instance-0000001c</name>
Nov 10 22:54:47 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:54:47 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:54:47 user nova-compute[75288]:   <metadata>
Nov 10 22:54:47 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:54:47 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:54:47 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-449796295</nova:name>
Nov 10 22:54:47 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:54:47</nova:creationTime>
Nov 10 22:54:47 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:54:47 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:54:47 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:54:47 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:54:47 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:54:47 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:54:47 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:54:47 user nova-compute[75288]:       <nova:owner>
Nov 10 22:54:47 user nova-compute[75288]:         <nova:user uuid="8aa64d78d0ed47e9af81121ea1e9e34a">tempest-ServerRescueNegativeTestJSON-423881024-project-member</nova:user>
Nov 10 22:54:47 user nova-compute[75288]:         <nova:project uuid="0fb8bee5841243ecbc00a012f27016fe">tempest-ServerRescueNegativeTestJSON-423881024</nova:project>
Nov 10 22:54:47 user nova-compute[75288]:       </nova:owner>
Nov 10 22:54:47 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:54:47 user nova-compute[75288]:       <nova:ports>
Nov 10 22:54:47 user nova-compute[75288]:         <nova:port uuid="a23e0df0-18b8-4950-9f59-5150861a4c28">
Nov 10 22:54:47 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:54:47 user nova-compute[75288]:         </nova:port>
Nov 10 22:54:47 user nova-compute[75288]:       </nova:ports>
Nov 10 22:54:47 user nova-compute[75288]:     </nova:instance>
Nov 10 22:54:47 user nova-compute[75288]:   </metadata>
Nov 10 22:54:47 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:54:47 user nova-compute[75288]:     <system>
Nov 10 22:54:47 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:54:47 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:54:47 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:54:47 user nova-compute[75288]:       <entry name="serial">0c73ba31-10a8-483a-9fcc-fe0beeeffba8</entry>
Nov 10 22:54:47 user nova-compute[75288]:       <entry name="uuid">0c73ba31-10a8-483a-9fcc-fe0beeeffba8</entry>
Nov 10 22:54:47 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:54:47 user nova-compute[75288]:     </system>
Nov 10 22:54:47 user nova-compute[75288]:   </sysinfo>
Nov 10 22:54:47 user nova-compute[75288]:   <os>
Nov 10 22:54:47 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:54:47 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:54:47 user nova-compute[75288]:   </os>
Nov 10 22:54:47 user nova-compute[75288]:   <features>
Nov 10 22:54:47 user nova-compute[75288]:     <acpi/>
Nov 10 22:54:47 user nova-compute[75288]:     <apic/>
Nov 10 22:54:47 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:54:47 user nova-compute[75288]:   </features>
Nov 10 22:54:47 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:54:47 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:54:47 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:54:47 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:54:47 user nova-compute[75288]:   </clock>
Nov 10 22:54:47 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:54:47 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:54:47 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:54:47 user nova-compute[75288]:   </cpu>
Nov 10 22:54:47 user nova-compute[75288]:   <devices>
Nov 10 22:54:47 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:54:47 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:54:47 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue"/>
Nov 10 22:54:47 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:54:47 user nova-compute[75288]:     </disk>
Nov 10 22:54:47 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:54:47 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:54:47 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk"/>
Nov 10 22:54:47 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:54:47 user nova-compute[75288]:     </disk>
Nov 10 22:54:47 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:54:47 user nova-compute[75288]:       <mac address="fa:16:3e:04:76:81"/>
Nov 10 22:54:47 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:54:47 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:54:47 user nova-compute[75288]:       <target dev="tapa23e0df0-18"/>
Nov 10 22:54:47 user nova-compute[75288]:     </interface>
Nov 10 22:54:47 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:54:47 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/console.log" append="off"/>
Nov 10 22:54:47 user nova-compute[75288]:     </serial>
Nov 10 22:54:47 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:54:47 user nova-compute[75288]:     <video>
Nov 10 22:54:47 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:54:47 user nova-compute[75288]:     </video>
Nov 10 22:54:47 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:54:47 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:54:47 user nova-compute[75288]:     </rng>
Nov 10 22:54:47 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:54:47 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:54:47 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:54:47 user nova-compute[75288]:     </memballoon>
Nov 10 22:54:47 user nova-compute[75288]:   </devices>
Nov 10 22:54:47 user nova-compute[75288]: </domain>
Nov 10 22:54:47 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:54:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance destroyed successfully.
Nov 10 22:54:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:54:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:54:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No VIF found with MAC fa:16:3e:04:76:81, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f91e56f1-c16e-4e91-a31e-0cb613be6e96 req-249aa173-8169-4e3d-9689-7fa112592bb1 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f91e56f1-c16e-4e91-a31e-0cb613be6e96 req-249aa173-8169-4e3d-9689-7fa112592bb1 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f91e56f1-c16e-4e91-a31e-0cb613be6e96 req-249aa173-8169-4e3d-9689-7fa112592bb1 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f91e56f1-c16e-4e91-a31e-0cb613be6e96 req-249aa173-8169-4e3d-9689-7fa112592bb1 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f91e56f1-c16e-4e91-a31e-0cb613be6e96 req-249aa173-8169-4e3d-9689-7fa112592bb1 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:54:49 user nova-compute[75288]: WARNING nova.compute.manager [req-f91e56f1-c16e-4e91-a31e-0cb613be6e96 req-249aa173-8169-4e3d-9689-7fa112592bb1 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state active and task_state rescuing.
Nov 10 22:54:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:54:51 user nova-compute[75288]: WARNING nova.compute.manager [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state active and task_state rescuing.
Nov 10 22:54:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:54:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:54:51 user nova-compute[75288]: WARNING nova.compute.manager [req-079657e7-315b-40f8-b54b-64c7e4d5eb5d req-dea97c4b-e0bd-49a4-9fae-1753d324635e service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state active and task_state rescuing.
Nov 10 22:54:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d2115709-80a9-415b-891c-e4450b551507 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:54:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:54:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'flavor' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:07 user nova-compute[75288]: INFO nova.compute.manager [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Attaching volume f00340fd-af72-476f-8c0b-e6f988c88d6d to /dev/vdb
Nov 10 22:55:07 user nova-compute[75288]: DEBUG os_brick.utils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[723adf01-2c29-47d7-8928-404022a38795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7548a4de-8f38-48fe-99e8-be8518d45567]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[298d536d-f6f7-4e7d-988e-1b6d920f3ce0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c374ce01-623a-479f-a248-681b81bf5620]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:55:07 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:55:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0295319-faaf-484e-aac4-0e804f4dead2]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG os_brick.utils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating existing volume attachment record: 2d5f0250-a3f8-41b8-86f5-d29267b2220a {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:55:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "451fa08f-beb7-4723-8b2f-e917421a2763" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "451fa08f-beb7-4723-8b2f-e917421a2763" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:11 user nova-compute[75288]: INFO nova.compute.manager [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Terminating instance
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-b1116870-6f7f-4a71-80a6-0dfc9635f225 req-9d7b9ed2-8685-4759-8972-7a84f3c75da1 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received event network-vif-unplugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b1116870-6f7f-4a71-80a6-0dfc9635f225 req-9d7b9ed2-8685-4759-8972-7a84f3c75da1 service nova] Acquiring lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b1116870-6f7f-4a71-80a6-0dfc9635f225 req-9d7b9ed2-8685-4759-8972-7a84f3c75da1 service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b1116870-6f7f-4a71-80a6-0dfc9635f225 req-9d7b9ed2-8685-4759-8972-7a84f3c75da1 service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-b1116870-6f7f-4a71-80a6-0dfc9635f225 req-9d7b9ed2-8685-4759-8972-7a84f3c75da1 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] No waiting events found dispatching network-vif-unplugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-b1116870-6f7f-4a71-80a6-0dfc9635f225 req-9d7b9ed2-8685-4759-8972-7a84f3c75da1 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received event network-vif-unplugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:55:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Instance destroyed successfully.
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lazy-loading 'resources' on Instance uuid 451fa08f-beb7-4723-8b2f-e917421a2763 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1780652658',display_name='tempest-VolumesNegativeTest-instance-1780652658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1780652658',id=32,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:53:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6def6603ae64b19be3fab36555a02d6',ramdisk_id='',reservation_id='r-q9xjqxvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1031338598',owner_user_name='tempest-VolumesNegativeTest-1031338598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:53:28Z,user_data=None,user_id='1ae6d9a8144d486182a72c54615ce1ae',uuid=451fa08f-beb7-4723-8b2f-e917421a2763,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Converting VIF {"id": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "address": "fa:16:3e:55:3d:03", "network": {"id": "251955df-0500-461a-9bf7-b6cae3c9e602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2049f10137ff459eb95071814d338e7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaa73e1f-5c", "ovs_interfaceid": "caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65,network=Network(251955df-0500-461a-9bf7-b6cae3c9e602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa73e1f-5c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG os_vif [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65,network=Network(251955df-0500-461a-9bf7-b6cae3c9e602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa73e1f-5c') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaa73e1f-5c, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=933b258b-ad6b-4be7-86b1-d45e3211bf6f) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:11 user nova-compute[75288]: INFO os_vif [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3d:03,bridge_name='br-int',has_traffic_filtering=True,id=caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65,network=Network(251955df-0500-461a-9bf7-b6cae3c9e602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaa73e1f-5c')
Nov 10 22:55:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Deleting instance files /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763_del
Nov 10 22:55:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Deletion of /opt/stack/data/nova/instances/451fa08f-beb7-4723-8b2f-e917421a2763_del complete
Nov 10 22:55:12 user nova-compute[75288]: INFO nova.compute.manager [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 22:55:12 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:55:12 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:55:12 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:13 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Took 1.06 seconds to deallocate network for instance.
Nov 10 22:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:13 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Deleted allocations for instance 451fa08f-beb7-4723-8b2f-e917421a2763
Nov 10 22:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8890148-bfe3-486a-9b95-3d991dca2e0a tempest-VolumesNegativeTest-1031338598 tempest-VolumesNegativeTest-1031338598-project-member] Lock "451fa08f-beb7-4723-8b2f-e917421a2763" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.437s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-b005a698-84f2-40a8-93e5-bcef99646db1 req-6a24cb1c-dc91-4514-b8e6-3aa9cdecde36 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received event network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b005a698-84f2-40a8-93e5-bcef99646db1 req-6a24cb1c-dc91-4514-b8e6-3aa9cdecde36 service nova] Acquiring lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b005a698-84f2-40a8-93e5-bcef99646db1 req-6a24cb1c-dc91-4514-b8e6-3aa9cdecde36 service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b005a698-84f2-40a8-93e5-bcef99646db1 req-6a24cb1c-dc91-4514-b8e6-3aa9cdecde36 service nova] Lock "451fa08f-beb7-4723-8b2f-e917421a2763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-b005a698-84f2-40a8-93e5-bcef99646db1 req-6a24cb1c-dc91-4514-b8e6-3aa9cdecde36 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] No waiting events found dispatching network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:13 user nova-compute[75288]: WARNING nova.compute.manager [req-b005a698-84f2-40a8-93e5-bcef99646db1 req-6a24cb1c-dc91-4514-b8e6-3aa9cdecde36 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received unexpected event network-vif-plugged-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 for instance with vm_state deleted and task_state None.
Nov 10 22:55:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-b005a698-84f2-40a8-93e5-bcef99646db1 req-6a24cb1c-dc91-4514-b8e6-3aa9cdecde36 service nova] [instance: 451fa08f-beb7-4723-8b2f-e917421a2763] Received event network-vif-deleted-caa73e1f-5c6c-4ccb-a7d9-3e22b635cf65 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:55:23 user nova-compute[75288]: INFO nova.compute.claims [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Claim successful on node user
Nov 10 22:55:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:55:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:55:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG nova.policy [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73df74584ffb411cb7d360b1a28c04cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73708f6fd47643998393f71f7b66c828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:55:24 user nova-compute[75288]: INFO nova.virt.block_device [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Booting with volume 0443cd30-ec8e-49c5-839d-f9b78fdc925c at /dev/vda
Nov 10 22:55:24 user nova-compute[75288]: DEBUG os_brick.utils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[905e9729-8a4d-4ef2-b20f-54f229f90c0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa56cce2-c061-4a33-b4ca-151ccd702abe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b920a01-e340-4355-b25f-796edfb31917]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a4c4c5-72ca-40a2-8bc6-9ed49fea3049]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:55:25 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:55:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d559d3d-7db2-49ab-ab7f-02c97a8151c2]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG os_brick.utils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updating existing volume attachment record: 4e6f0514-55bc-44f9-b82e-590f322fbffa {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Successfully created port: 2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Successfully updated port: 2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquired lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-changed-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Refreshing instance network info cache due to event network-changed-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] Acquiring lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:55:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updating instance_info_cache with network_info: [{"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Releasing lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance network_info: |[{"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] Acquired lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Refreshing network info cache for port 2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updated VIF entry in instance network info cache for port 2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updating instance_info_cache with network_info: [{"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6d33b1c3-6e81-4cb1-b24b-23f7a34f2174 req-1d2fe4f7-557e-40b2-ac8f-9f9b83d69b78 service nova] Releasing lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:55:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:55:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:55:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 22:55:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoJTqAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:55:35 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:55:35 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:55:35 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6de21-e7d7-45d1-ba6d-875d14638095]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:55:35 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe8d0b8-ac73-410e-a26f-0e464a0b04f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d] added
Nov 10 22:55:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.122s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d8be1-a325-40e3-9a57-32902d07041a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532818f-dd2b-4f4f-9f13-5f1f05411367]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRoJTqAb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRoJTqAb" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4d2ad0-35fc-4e91-bf29-17acd941c579]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRoJTqAb'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e6bb4a-fe2c-4fe0-9d0e-975c9b2f3bc9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22da0a0-0251-4fa0-af16-57c4d05f38d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 22:55:35 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 22:55:35 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:55:35 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 22:55:35 user nova-compute[75288]: 
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622dbde-1c5d-43d6-8c39-c462b70ae9ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260]
Nov 10 22:55:35 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260] successful.
Nov 10 22:55:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4ddbeb-7cbe-4965-94f2-4fdfbd3e663c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2199ad3-1e6a-4e8a-bacc-046b050ace52]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.471s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[587956fa-d4ca-4ea3-98dd-39db67079e33]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoJTqAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23862616237323931', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862616237323931', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:55:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8086MB free_disk=25.076133728027344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'flavor' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:55:36 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:55:36 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:55:36 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:55:36 user nova-compute[75288]:   <serial>f00340fd-af72-476f-8c0b-e6f988c88d6d</serial>
Nov 10 22:55:36 user nova-compute[75288]: </disk>
Nov 10 22:55:36 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 60307487-1cfc-412f-86c8-994b8d9b47db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 23bd4722-1079-4562-998d-c2e7a77ae541 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:55:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No VIF found with MAC fa:16:3e:c7:79:ec, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c1f51e90-5577-48bf-8498-f0128dad0855 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.887s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.894s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:38 user nova-compute[75288]: INFO nova.compute.manager [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Rescuing
Nov 10 22:55:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:55:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b25e33e-6b37-4b24-abb4-e432f983c4c9 req-32a86872-8cda-4cd7-aeaa-32a53b42a827 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b25e33e-6b37-4b24-abb4-e432f983c4c9 req-32a86872-8cda-4cd7-aeaa-32a53b42a827 service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b25e33e-6b37-4b24-abb4-e432f983c4c9 req-32a86872-8cda-4cd7-aeaa-32a53b42a827 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b25e33e-6b37-4b24-abb4-e432f983c4c9 req-32a86872-8cda-4cd7-aeaa-32a53b42a827 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b25e33e-6b37-4b24-abb4-e432f983c4c9 req-32a86872-8cda-4cd7-aeaa-32a53b42a827 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:40 user nova-compute[75288]: WARNING nova.compute.manager [req-6b25e33e-6b37-4b24-abb4-e432f983c4c9 req-32a86872-8cda-4cd7-aeaa-32a53b42a827 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state active and task_state rescuing.
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance destroyed successfully.
Nov 10 22:55:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Attempting a stable device rescue
Nov 10 22:55:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 22:55:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Creating image(s)
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'trusted_certs' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "af7db2d73446cf288e24c95229033d80eca91e7c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "af7db2d73446cf288e24c95229033d80eca91e7c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d388847-38d5-4b4c-892b-317c82b3c350 req-702b1588-1f5d-48c8-9702-6d106d6f1217 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d388847-38d5-4b4c-892b-317c82b3c350 req-702b1588-1f5d-48c8-9702-6d106d6f1217 service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d388847-38d5-4b4c-892b-317c82b3c350 req-702b1588-1f5d-48c8-9702-6d106d6f1217 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d388847-38d5-4b4c-892b-317c82b3c350 req-702b1588-1f5d-48c8-9702-6d106d6f1217 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d388847-38d5-4b4c-892b-317c82b3c350 req-702b1588-1f5d-48c8-9702-6d106d6f1217 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:42 user nova-compute[75288]: WARNING nova.compute.manager [req-7d388847-38d5-4b4c-892b-317c82b3c350 req-702b1588-1f5d-48c8-9702-6d106d6f1217 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state active and task_state rescuing.
Nov 10 22:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:42 user nova-compute[75288]: INFO nova.compute.manager [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Terminating instance
Nov 10 22:55:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.part --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG nova.virt.images [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] f7c3e7e6-52eb-42e2-bc04-c8c3fa102a0e was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.part /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.part /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.converted" returned: 0 in 0.403s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-41cd54ce-c995-4967-bbe6-baf2edd96b8e req-35b98cea-238e-41ce-8953-4f3e320d0ad2 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-vif-unplugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41cd54ce-c995-4967-bbe6-baf2edd96b8e req-35b98cea-238e-41ce-8953-4f3e320d0ad2 service nova] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41cd54ce-c995-4967-bbe6-baf2edd96b8e req-35b98cea-238e-41ce-8953-4f3e320d0ad2 service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41cd54ce-c995-4967-bbe6-baf2edd96b8e req-35b98cea-238e-41ce-8953-4f3e320d0ad2 service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-41cd54ce-c995-4967-bbe6-baf2edd96b8e req-35b98cea-238e-41ce-8953-4f3e320d0ad2 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] No waiting events found dispatching network-vif-unplugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-41cd54ce-c995-4967-bbe6-baf2edd96b8e req-35b98cea-238e-41ce-8953-4f3e320d0ad2 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-vif-unplugged-e7bac544-b5fc-4020-af9f-183a0208faa1 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "af7db2d73446cf288e24c95229033d80eca91e7c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.341s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "af7db2d73446cf288e24c95229033d80eca91e7c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "af7db2d73446cf288e24c95229033d80eca91e7c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Instance destroyed successfully.
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lazy-loading 'resources' on Instance uuid d47e90fb-6b83-4b5e-98dd-3c6e86951006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-78431812',display_name='tempest-SnapshotDataIntegrityTests-server-78431812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-78431812',id=23,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzO1w095MqiWmB1DP0Wfehf0Syfzumc8581xkK9GuzcwmJ2AnDupPEb2BXk90aQ0Ql9nZuFg5lvEPNQbKLuDHmaJlZPA+RVFuGBZAd5MYGW7mvE1PwZQ8IKGfbXxhtZCQ==',key_name='tempest-keypair-560160790',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d112e7d16b9643a88cd0f352a57c935c',ramdisk_id='',reservation_id='r-mtki41rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1829388035',owner_user_name='tempest-SnapshotDataIntegrityTests-1829388035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:44:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe7181c0c964009b7a5707633a23191',uuid=d47e90fb-6b83-4b5e-98dd-3c6e86951006,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Converting VIF {"id": "e7bac544-b5fc-4020-af9f-183a0208faa1", "address": "fa:16:3e:81:41:97", "network": {"id": "a405802d-4cc0-49ed-9180-4a2708c881d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1768867398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d112e7d16b9643a88cd0f352a57c935c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7bac544-b5", "ovs_interfaceid": "e7bac544-b5fc-4020-af9f-183a0208faa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:97,bridge_name='br-int',has_traffic_filtering=True,id=e7bac544-b5fc-4020-af9f-183a0208faa1,network=Network(a405802d-4cc0-49ed-9180-4a2708c881d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7bac544-b5') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG os_vif [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:97,bridge_name='br-int',has_traffic_filtering=True,id=e7bac544-b5fc-4020-af9f-183a0208faa1,network=Network(a405802d-4cc0-49ed-9180-4a2708c881d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7bac544-b5') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7bac544-b5, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c --force-share --output=json" returned: 0 in 0.590s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c,backing_fmt=raw /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:55:43 user nova-compute[75288]: INFO nova.compute.claims [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Claim successful on node user
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c,backing_fmt=raw /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.rescue" returned: 0 in 0.066s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "af7db2d73446cf288e24c95229033d80eca91e7c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.662s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'migration_context' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0522f53f-3a4a-4b37-887d-906ac70e5fad) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Object Instance<04509269-e685-4bdb-8663-6c4a27fb8169> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Start _get_guest_xml network_info=[{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "vif_mac": "fa:16:3e:c7:79:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f7c3e7e6-52eb-42e2-bc04-c8c3fa102a0e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoJTqAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '04509269-e685-4bdb-8663-6c4a27fb8169', 'attached_at': '', 'detached_at': '', 'volume_id': 'f00340fd-af72-476f-8c0b-e6f988c88d6d', 'serial': 'f00340fd-af72-476f-8c0b-e6f988c88d6d'}, 'mount_device': '/dev/vdb', 'attachment_id': '2d5f0250-a3f8-41b8-86f5-d29267b2220a', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'resources' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:43 user nova-compute[75288]: INFO os_vif [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:41:97,bridge_name='br-int',has_traffic_filtering=True,id=e7bac544-b5fc-4020-af9f-183a0208faa1,network=Network(a405802d-4cc0-49ed-9180-4a2708c881d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7bac544-b5')
Nov 10 22:55:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Deleting instance files /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006_del
Nov 10 22:55:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Deletion of /opt/stack/data/nova/instances/d47e90fb-6b83-4b5e-98dd-3c6e86951006_del complete
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Object Instance<04509269-e685-4bdb-8663-6c4a27fb8169> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'numa_topology' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Object Instance<04509269-e685-4bdb-8663-6c4a27fb8169> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:55:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Object Instance<04509269-e685-4bdb-8663-6c4a27fb8169> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoJTqAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:55:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:55:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:55:44 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: INFO nova.compute.manager [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5258cabd-2265-4646-aa5c-3225445f5510]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WRoJTqAb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 22:55:44 user nova-compute[75288]: node.name = iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d
Nov 10 22:55:44 user nova-compute[75288]: node.tpgt = -1
Nov 10 22:55:44 user nova-compute[75288]: node.startup = automatic
Nov 10 22:55:44 user nova-compute[75288]: node.leading_login = No
Nov 10 22:55:44 user nova-compute[75288]: iface.iscsi_ifacename = default
Nov 10 22:55:44 user nova-compute[75288]: iface.net_ifacename = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.ipaddress = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.prefix_len = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.hwaddress = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.transport_name = tcp
Nov 10 22:55:44 user nova-compute[75288]: iface.initiatorname = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.state = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.vlan_id = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.vlan_priority = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.vlan_state = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.iface_num = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.mtu = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.port = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.bootproto = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.subnet_mask = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.gateway = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_alt_client_id = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_dns = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_learn_iqn = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_vendor_id_state = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_vendor_id = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.dhcp_slp_da = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.fragmentation = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.gratuitous_arp = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.incoming_forwarding = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.tos_state = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.tos = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.ttl = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.delayed_ack = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.tcp_nagle = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.tcp_wsf_state = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.tcp_wsf = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.tcp_timer_scale = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.tcp_timestamp = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.redirect = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.def_task_mgmt_timeout = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.header_digest = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.data_digest = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.immediate_data = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.initial_r2t = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.data_seq_inorder = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.data_pdu_inorder = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.erl = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.max_receive_data_len = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.first_burst_len = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.max_outstanding_r2t = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.max_burst_len = 0
Nov 10 22:55:44 user nova-compute[75288]: iface.chap_auth = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.bidi_chap = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.strict_login_compliance = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.discovery_auth = <empty>
Nov 10 22:55:44 user nova-compute[75288]: iface.discovery_logout = <empty>
Nov 10 22:55:44 user nova-compute[75288]: node.discovery_address = <empty>
Nov 10 22:55:44 user nova-compute[75288]: node.discovery_port = 0
Nov 10 22:55:44 user nova-compute[75288]: node.discovery_type = static
Nov 10 22:55:44 user nova-compute[75288]: node.session.initial_cmdsn = 0
Nov 10 22:55:44 user nova-compute[75288]: node.session.initial_login_retry_max = 8
Nov 10 22:55:44 user nova-compute[75288]: node.session.xmit_thread_priority = -20
Nov 10 22:55:44 user nova-compute[75288]: node.session.cmds_max = 128
Nov 10 22:55:44 user nova-compute[75288]: node.session.queue_depth = 32
Nov 10 22:55:44 user nova-compute[75288]: node.session.nr_sessions = 1
Nov 10 22:55:44 user nova-compute[75288]: node.session.auth.authmethod = CHAP
Nov 10 22:55:44 user nova-compute[75288]: node.session.auth.username = WRoJTqAb
Nov 10 22:55:44 user nova-compute[75288]: node.session.auth.password = ***
Nov 10 22:55:44 user nova-compute[75288]: node.session.auth.username_in = <empty>
Nov 10 22:55:44 user nova-compute[75288]: node.session.auth.password_in = <empty>
Nov 10 22:55:44 user nova-compute[75288]: node.session.auth.chap_algs = MD5
Nov 10 22:55:44 user nova-compute[75288]: node.session.timeo.replacement_timeout = 120
Nov 10 22:55:44 user nova-compute[75288]: node.session.err_timeo.abort_timeout = 15
Nov 10 22:55:44 user nova-compute[75288]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 22:55:44 user nova-compute[75288]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 22:55:44 user nova-compute[75288]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.FastAbort = Yes
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.InitialR2T = No
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.ImmediateData = Yes
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.MaxConnections = 1
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 22:55:44 user nova-compute[75288]: node.session.iscsi.ERL = 0
Nov 10 22:55:44 user nova-compute[75288]: node.session.scan = manual
Nov 10 22:55:44 user nova-compute[75288]: node.session.reopen_max = 0
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].address = 172.16.0.220
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].port = 3260
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].startup = manual
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].tcp.window_size = 524288
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].tcp.type_of_service = 0
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].timeo.logout_timeout = 15
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].timeo.login_timeout = 15
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].timeo.auth_timeout = 45
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].iscsi.DataDigest = None
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].iscsi.IFMarker = No
Nov 10 22:55:44 user nova-compute[75288]: node.conn[0].iscsi.OFMarker = No
Nov 10 22:55:44 user nova-compute[75288]: # END RECORD
Nov 10 22:55:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c020140-fb4e-4311-824d-6cc7b5331107]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b809faf-61ee-4054-9955-6fc27ec66e44]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRoJTqAb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRoJTqAb" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01317d4-a65a-40cb-82bf-87820bfda23c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRoJTqAb'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba28432-fd89-4df5-8240-17397e4e47d7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f62a3-4ce9-4b74-9fd6-46a91d172e94]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] HCTL ('33', '0', '0', 0) found on session 32 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed12c21-9fb3-47e4-ae09-d4af0fc62689]: (4, ('0 0 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Searching for a device in session 32 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoJTqAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23862616237323931', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862616237323931', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-970360194',display_name='tempest-ServerStableDeviceRescueTest-server-970360194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-970360194',id=31,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObVP8O6Nr1VHNeR/aDPh9glerFl/Ksu5hCAH/IB2ClN5ICro3vIhpZ6yIeZWAv3x/Z6at08dxbuQqBi0goqSR/VYzNupGo0JUKcvS6bysNUtzCZg+QESV5SyOA+OzoGwQ==',key_name='tempest-keypair-1094930237',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9547e47532da49bcb20296c6485577a2',ramdisk_id='',reservation_id='r-x5apaqpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-239004557',owner_user_name='tempest-ServerStableDeviceRescueTest-239004557-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9010fc645ad54495bd090cfffad16a0e',uuid=04509269-e685-4bdb-8663-6c4a27fb8169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "vif_mac": "fa:16:3e:c7:79:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converting VIF {"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "vif_mac": "fa:16:3e:c7:79:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.objects.instance [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'pci_devices' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.objects.base [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Object Instance<04509269-e685-4bdb-8663-6c4a27fb8169> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:55:44 user nova-compute[75288]:   <uuid>04509269-e685-4bdb-8663-6c4a27fb8169</uuid>
Nov 10 22:55:44 user nova-compute[75288]:   <name>instance-0000001f</name>
Nov 10 22:55:44 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:55:44 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:55:44 user nova-compute[75288]:   <metadata>
Nov 10 22:55:44 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:55:44 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:55:44 user nova-compute[75288]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-970360194</nova:name>
Nov 10 22:55:44 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:55:43</nova:creationTime>
Nov 10 22:55:44 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:55:44 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:55:44 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:55:44 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:55:44 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:55:44 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:55:44 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:55:44 user nova-compute[75288]:       <nova:owner>
Nov 10 22:55:44 user nova-compute[75288]:         <nova:user uuid="9010fc645ad54495bd090cfffad16a0e">tempest-ServerStableDeviceRescueTest-239004557-project-member</nova:user>
Nov 10 22:55:44 user nova-compute[75288]:         <nova:project uuid="9547e47532da49bcb20296c6485577a2">tempest-ServerStableDeviceRescueTest-239004557</nova:project>
Nov 10 22:55:44 user nova-compute[75288]:       </nova:owner>
Nov 10 22:55:44 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:55:44 user nova-compute[75288]:       <nova:ports>
Nov 10 22:55:44 user nova-compute[75288]:         <nova:port uuid="fc3f6fa3-d1c2-4c8b-a442-15071214b6c8">
Nov 10 22:55:44 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 22:55:44 user nova-compute[75288]:         </nova:port>
Nov 10 22:55:44 user nova-compute[75288]:       </nova:ports>
Nov 10 22:55:44 user nova-compute[75288]:     </nova:instance>
Nov 10 22:55:44 user nova-compute[75288]:   </metadata>
Nov 10 22:55:44 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:55:44 user nova-compute[75288]:     <system>
Nov 10 22:55:44 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:55:44 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:55:44 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:55:44 user nova-compute[75288]:       <entry name="serial">04509269-e685-4bdb-8663-6c4a27fb8169</entry>
Nov 10 22:55:44 user nova-compute[75288]:       <entry name="uuid">04509269-e685-4bdb-8663-6c4a27fb8169</entry>
Nov 10 22:55:44 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:55:44 user nova-compute[75288]:     </system>
Nov 10 22:55:44 user nova-compute[75288]:   </sysinfo>
Nov 10 22:55:44 user nova-compute[75288]:   <os>
Nov 10 22:55:44 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:55:44 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:55:44 user nova-compute[75288]:   </os>
Nov 10 22:55:44 user nova-compute[75288]:   <features>
Nov 10 22:55:44 user nova-compute[75288]:     <acpi/>
Nov 10 22:55:44 user nova-compute[75288]:     <apic/>
Nov 10 22:55:44 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:55:44 user nova-compute[75288]:   </features>
Nov 10 22:55:44 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:55:44 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:55:44 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:55:44 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:55:44 user nova-compute[75288]:   </clock>
Nov 10 22:55:44 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:55:44 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:55:44 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:55:44 user nova-compute[75288]:   </cpu>
Nov 10 22:55:44 user nova-compute[75288]:   <devices>
Nov 10 22:55:44 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:55:44 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:55:44 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk"/>
Nov 10 22:55:44 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:55:44 user nova-compute[75288]:     </disk>
Nov 10 22:55:44 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:55:44 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:55:44 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 22:55:44 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:55:44 user nova-compute[75288]:       <serial>f00340fd-af72-476f-8c0b-e6f988c88d6d</serial>
Nov 10 22:55:44 user nova-compute[75288]:     </disk>
Nov 10 22:55:44 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:55:44 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:55:44 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.rescue"/>
Nov 10 22:55:44 user nova-compute[75288]:       <target dev="vdc" bus="virtio"/>
Nov 10 22:55:44 user nova-compute[75288]:       <boot order="1"/>
Nov 10 22:55:44 user nova-compute[75288]:     </disk>
Nov 10 22:55:44 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:55:44 user nova-compute[75288]:       <mac address="fa:16:3e:c7:79:ec"/>
Nov 10 22:55:44 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:44 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:55:44 user nova-compute[75288]:       <target dev="tapfc3f6fa3-d1"/>
Nov 10 22:55:44 user nova-compute[75288]:     </interface>
Nov 10 22:55:44 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:55:44 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/console.log" append="off"/>
Nov 10 22:55:44 user nova-compute[75288]:     </serial>
Nov 10 22:55:44 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:55:44 user nova-compute[75288]:     <video>
Nov 10 22:55:44 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:44 user nova-compute[75288]:     </video>
Nov 10 22:55:44 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:55:44 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:55:44 user nova-compute[75288]:     </rng>
Nov 10 22:55:44 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:55:44 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:55:44 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:55:44 user nova-compute[75288]:     </memballoon>
Nov 10 22:55:44 user nova-compute[75288]:   </devices>
Nov 10 22:55:44 user nova-compute[75288]: </domain>
Nov 10 22:55:44 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:55:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance destroyed successfully.
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] No VIF found with MAC fa:16:3e:c7:79:ec, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:55:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.policy [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75dd1a64271449cd93203fe3505e6a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019729fd4a184b7ab31cfd1022f897c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:55:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Creating image(s)
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "/opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "/opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "/opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-90453129-f5a6-4b92-8422-6fbe1fa89990 req-96647814-4f3c-4eae-bec1-30de3bf0a4f7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-vif-deleted-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:44 user nova-compute[75288]: INFO nova.compute.manager [req-90453129-f5a6-4b92-8422-6fbe1fa89990 req-96647814-4f3c-4eae-bec1-30de3bf0a4f7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Neutron deleted interface e7bac544-b5fc-4020-af9f-183a0208faa1; detaching it from the instance and deleting it from the info cache
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-90453129-f5a6-4b92-8422-6fbe1fa89990 req-96647814-4f3c-4eae-bec1-30de3bf0a4f7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:44 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Took 0.91 seconds to deallocate network for instance.
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-90453129-f5a6-4b92-8422-6fbe1fa89990 req-96647814-4f3c-4eae-bec1-30de3bf0a4f7 service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Detach interface failed, port_id=e7bac544-b5fc-4020-af9f-183a0208faa1, reason: Instance d47e90fb-6b83-4b5e-98dd-3c6e86951006 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:55:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk 1073741824" returned: 0 in 0.079s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Successfully created port: 00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-c135076d-b123-4f3d-af86-4f12dec80172 req-93077ebc-e0b5-4d35-b193-012392ceddfb service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received event network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c135076d-b123-4f3d-af86-4f12dec80172 req-93077ebc-e0b5-4d35-b193-012392ceddfb service nova] Acquiring lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c135076d-b123-4f3d-af86-4f12dec80172 req-93077ebc-e0b5-4d35-b193-012392ceddfb service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c135076d-b123-4f3d-af86-4f12dec80172 req-93077ebc-e0b5-4d35-b193-012392ceddfb service nova] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-c135076d-b123-4f3d-af86-4f12dec80172 req-93077ebc-e0b5-4d35-b193-012392ceddfb service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] No waiting events found dispatching network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:45 user nova-compute[75288]: WARNING nova.compute.manager [req-c135076d-b123-4f3d-af86-4f12dec80172 req-93077ebc-e0b5-4d35-b193-012392ceddfb service nova] [instance: d47e90fb-6b83-4b5e-98dd-3c6e86951006] Received unexpected event network-vif-plugged-e7bac544-b5fc-4020-af9f-183a0208faa1 for instance with vm_state deleted and task_state None.
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.270s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Cannot resize image /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Ensure instance console log exists: /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:45 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Deleted allocations for instance d47e90fb-6b83-4b5e-98dd-3c6e86951006
Nov 10 22:55:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-654dd28f-635f-4c57-b6ff-6978ac508513 tempest-SnapshotDataIntegrityTests-1829388035 tempest-SnapshotDataIntegrityTests-1829388035-project-member] Lock "d47e90fb-6b83-4b5e-98dd-3c6e86951006" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.362s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Successfully updated port: 00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquired lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-changed-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Refreshing instance network info cache due to event network-changed-00dde69e-52cb-4abc-899b-927901184704. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] Acquiring lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:46 user nova-compute[75288]: WARNING nova.compute.manager [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state active and task_state rescuing.
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:46 user nova-compute[75288]: WARNING nova.compute.manager [req-6eab3bf9-1b7e-4c3b-89b6-9f0d8ee52107 req-eefe87ac-3be6-42f5-9c47-610db1c6a79b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state active and task_state rescuing.
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updating instance_info_cache with network_info: [{"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Releasing lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Instance network_info: |[{"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] Acquired lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Refreshing network info cache for port 00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Start _get_guest_xml network_info=[{"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:55:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1381810489',display_name='tempest-TestServerVolumeAttachmentScenario-server-1381810489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1381810489',id=35,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZSwNw8d8vwjd0XE9T/Za/PL/LtmiiLFl77HRzuHvB64WhzfUr9s2bBvXvsF3htW7P12pN8G2apSi0UVd4retUWASFCU4tYj5Uw76izBa/mY+02U6rvbiI/5dtJfs6dSw==',key_name='tempest-keypair-1985505397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='019729fd4a184b7ab31cfd1022f897c5',ramdisk_id='',reservation_id='r-j0ljdwd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1220589635',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1220589635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75dd1a64271449cd93203fe3505e6a6d',uuid=41f056ca-4cf8-423a-8a10-626d6091d835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Converting VIF {"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4e:a0,bridge_name='br-int',has_traffic_filtering=True,id=00dde69e-52cb-4abc-899b-927901184704,network=Network(c281d140-ce23-4a93-a732-8e63c39932ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00dde69e-52') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'pci_devices' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:55:47 user nova-compute[75288]:   <uuid>41f056ca-4cf8-423a-8a10-626d6091d835</uuid>
Nov 10 22:55:47 user nova-compute[75288]:   <name>instance-00000023</name>
Nov 10 22:55:47 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:55:47 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:55:47 user nova-compute[75288]:   <metadata>
Nov 10 22:55:47 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:55:47 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:55:47 user nova-compute[75288]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1381810489</nova:name>
Nov 10 22:55:47 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:55:47</nova:creationTime>
Nov 10 22:55:47 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:55:47 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:55:47 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:55:47 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:55:47 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:55:47 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:55:47 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:55:47 user nova-compute[75288]:       <nova:owner>
Nov 10 22:55:47 user nova-compute[75288]:         <nova:user uuid="75dd1a64271449cd93203fe3505e6a6d">tempest-TestServerVolumeAttachmentScenario-1220589635-project-member</nova:user>
Nov 10 22:55:47 user nova-compute[75288]:         <nova:project uuid="019729fd4a184b7ab31cfd1022f897c5">tempest-TestServerVolumeAttachmentScenario-1220589635</nova:project>
Nov 10 22:55:47 user nova-compute[75288]:       </nova:owner>
Nov 10 22:55:47 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:55:47 user nova-compute[75288]:       <nova:ports>
Nov 10 22:55:47 user nova-compute[75288]:         <nova:port uuid="00dde69e-52cb-4abc-899b-927901184704">
Nov 10 22:55:47 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 22:55:47 user nova-compute[75288]:         </nova:port>
Nov 10 22:55:47 user nova-compute[75288]:       </nova:ports>
Nov 10 22:55:47 user nova-compute[75288]:     </nova:instance>
Nov 10 22:55:47 user nova-compute[75288]:   </metadata>
Nov 10 22:55:47 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:55:47 user nova-compute[75288]:     <system>
Nov 10 22:55:47 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:55:47 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:55:47 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:55:47 user nova-compute[75288]:       <entry name="serial">41f056ca-4cf8-423a-8a10-626d6091d835</entry>
Nov 10 22:55:47 user nova-compute[75288]:       <entry name="uuid">41f056ca-4cf8-423a-8a10-626d6091d835</entry>
Nov 10 22:55:47 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:55:47 user nova-compute[75288]:     </system>
Nov 10 22:55:47 user nova-compute[75288]:   </sysinfo>
Nov 10 22:55:47 user nova-compute[75288]:   <os>
Nov 10 22:55:47 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:55:47 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:55:47 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:55:47 user nova-compute[75288]:   </os>
Nov 10 22:55:47 user nova-compute[75288]:   <features>
Nov 10 22:55:47 user nova-compute[75288]:     <acpi/>
Nov 10 22:55:47 user nova-compute[75288]:     <apic/>
Nov 10 22:55:47 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:55:47 user nova-compute[75288]:   </features>
Nov 10 22:55:47 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:55:47 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:55:47 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:55:47 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:55:47 user nova-compute[75288]:   </clock>
Nov 10 22:55:47 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:55:47 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:55:47 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:55:47 user nova-compute[75288]:   </cpu>
Nov 10 22:55:47 user nova-compute[75288]:   <devices>
Nov 10 22:55:47 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:55:47 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:55:47 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk"/>
Nov 10 22:55:47 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:55:47 user nova-compute[75288]:     </disk>
Nov 10 22:55:47 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:55:47 user nova-compute[75288]:       <mac address="fa:16:3e:4d:4e:a0"/>
Nov 10 22:55:47 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:47 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:55:47 user nova-compute[75288]:       <target dev="tap00dde69e-52"/>
Nov 10 22:55:47 user nova-compute[75288]:     </interface>
Nov 10 22:55:47 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:55:47 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/console.log" append="off"/>
Nov 10 22:55:47 user nova-compute[75288]:     </serial>
Nov 10 22:55:47 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:55:47 user nova-compute[75288]:     <video>
Nov 10 22:55:47 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:47 user nova-compute[75288]:     </video>
Nov 10 22:55:47 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:55:47 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:55:47 user nova-compute[75288]:     </rng>
Nov 10 22:55:47 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:55:47 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:55:47 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:55:47 user nova-compute[75288]:     </memballoon>
Nov 10 22:55:47 user nova-compute[75288]:   </devices>
Nov 10 22:55:47 user nova-compute[75288]: </domain>
Nov 10 22:55:47 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1381810489',display_name='tempest-TestServerVolumeAttachmentScenario-server-1381810489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1381810489',id=35,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZSwNw8d8vwjd0XE9T/Za/PL/LtmiiLFl77HRzuHvB64WhzfUr9s2bBvXvsF3htW7P12pN8G2apSi0UVd4retUWASFCU4tYj5Uw76izBa/mY+02U6rvbiI/5dtJfs6dSw==',key_name='tempest-keypair-1985505397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='019729fd4a184b7ab31cfd1022f897c5',ramdisk_id='',reservation_id='r-j0ljdwd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1220589635',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1220589635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75dd1a64271449cd93203fe3505e6a6d',uuid=41f056ca-4cf8-423a-8a10-626d6091d835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Converting VIF {"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4e:a0,bridge_name='br-int',has_traffic_filtering=True,id=00dde69e-52cb-4abc-899b-927901184704,network=Network(c281d140-ce23-4a93-a732-8e63c39932ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00dde69e-52') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG os_vif [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4e:a0,bridge_name='br-int',has_traffic_filtering=True,id=00dde69e-52cb-4abc-899b-927901184704,network=Network(c281d140-ce23-4a93-a732-8e63c39932ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00dde69e-52') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bdeb497-0495-5dbc-9a1b-30c471de8f98', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00dde69e-52, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00dde69e-52, col_values=(('qos', UUID('d65cdc02-d7af-4cc6-8644-6dc8dcfaadb0')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00dde69e-52, col_values=(('external_ids', {'iface-id': '00dde69e-52cb-4abc-899b-927901184704', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:4e:a0', 'vm-uuid': '41f056ca-4cf8-423a-8a10-626d6091d835'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:47 user nova-compute[75288]: INFO os_vif [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4e:a0,bridge_name='br-int',has_traffic_filtering=True,id=00dde69e-52cb-4abc-899b-927901184704,network=Network(c281d140-ce23-4a93-a732-8e63c39932ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00dde69e-52')
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No VIF found with MAC fa:16:3e:4d:4e:a0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updated VIF entry in instance network info cache for port 00dde69e-52cb-4abc-899b-927901184704. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updating instance_info_cache with network_info: [{"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8da0c51e-361f-442f-b9ba-94c8d3c8aac9 req-0be51c9b-65c0-458e-b0b4-95be236a0a1c service nova] Releasing lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-368ce8ea-e7a6-4d37-86b0-c4163d14ec3b tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-ed869e21-7d47-4dca-ac1c-bff01ae5739e req-4261fb49-5aaf-4c8d-a00b-863a4eb9eea7 service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ed869e21-7d47-4dca-ac1c-bff01ae5739e req-4261fb49-5aaf-4c8d-a00b-863a4eb9eea7 service nova] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ed869e21-7d47-4dca-ac1c-bff01ae5739e req-4261fb49-5aaf-4c8d-a00b-863a4eb9eea7 service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ed869e21-7d47-4dca-ac1c-bff01ae5739e req-4261fb49-5aaf-4c8d-a00b-863a4eb9eea7 service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-ed869e21-7d47-4dca-ac1c-bff01ae5739e req-4261fb49-5aaf-4c8d-a00b-863a4eb9eea7 service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] No waiting events found dispatching network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:49 user nova-compute[75288]: WARNING nova.compute.manager [req-ed869e21-7d47-4dca-ac1c-bff01ae5739e req-4261fb49-5aaf-4c8d-a00b-863a4eb9eea7 service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received unexpected event network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 for instance with vm_state building and task_state spawning.
Nov 10 22:55:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:55:50 user nova-compute[75288]: INFO nova.compute.claims [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Claim successful on node user
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.network.neutron [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:55:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.policy [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8212f40024264c4d930417929bd14f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622aa0fa0ece481b88f19e55fe547117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:55:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Creating image(s)
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "/opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "/opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "/opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk 1073741824" returned: 0 in 0.054s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-fcab2f1c-f62b-4d21-859e-d370f9188e1b req-94720d4c-a123-45de-9e44-dc49ad10f31a service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fcab2f1c-f62b-4d21-859e-d370f9188e1b req-94720d4c-a123-45de-9e44-dc49ad10f31a service nova] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fcab2f1c-f62b-4d21-859e-d370f9188e1b req-94720d4c-a123-45de-9e44-dc49ad10f31a service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fcab2f1c-f62b-4d21-859e-d370f9188e1b req-94720d4c-a123-45de-9e44-dc49ad10f31a service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-fcab2f1c-f62b-4d21-859e-d370f9188e1b req-94720d4c-a123-45de-9e44-dc49ad10f31a service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] No waiting events found dispatching network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:51 user nova-compute[75288]: WARNING nova.compute.manager [req-fcab2f1c-f62b-4d21-859e-d370f9188e1b req-94720d4c-a123-45de-9e44-dc49ad10f31a service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received unexpected event network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 for instance with vm_state building and task_state spawning.
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Successfully created port: e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:55:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Instance spawned successfully.
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.253s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:51 user nova-compute[75288]: INFO nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Took 7.09 seconds to spawn the instance on the hypervisor.
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:55:51 user nova-compute[75288]: INFO nova.compute.manager [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Took 8.51 seconds to build instance.
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Cannot resize image /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Ensure instance console log exists: /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6be07ab3-cea2-42b5-b674-b0c9a499e631 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.760s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Successfully updated port: e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "refresh_cache-e00d0437-6c97-4100-9c9a-11e84e52b0b1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquired lock "refresh_cache-e00d0437-6c97-4100-9c9a-11e84e52b0b1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received event network-changed-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Refreshing instance network info cache due to event network-changed-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] Acquiring lock "refresh_cache-e00d0437-6c97-4100-9c9a-11e84e52b0b1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Updating instance_info_cache with network_info: [{"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Releasing lock "refresh_cache-e00d0437-6c97-4100-9c9a-11e84e52b0b1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Instance network_info: |[{"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] Acquired lock "refresh_cache-e00d0437-6c97-4100-9c9a-11e84e52b0b1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Refreshing network info cache for port e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Start _get_guest_xml network_info=[{"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:55:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-370130682',display_name='tempest-VolumesActionsTest-instance-370130682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-370130682',id=36,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622aa0fa0ece481b88f19e55fe547117',ramdisk_id='',reservation_id='r-0ppmctit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-92480672',owner_user_name='tempest-VolumesActionsTest-92480672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:55:51Z,user_data=None,user_id='8212f40024264c4d930417929bd14f96',uuid=e00d0437-6c97-4100-9c9a-11e84e52b0b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converting VIF {"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:76:a9,bridge_name='br-int',has_traffic_filtering=True,id=e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape786bd48-fe') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.objects.instance [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lazy-loading 'pci_devices' on Instance uuid e00d0437-6c97-4100-9c9a-11e84e52b0b1 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:55:52 user nova-compute[75288]:   <uuid>e00d0437-6c97-4100-9c9a-11e84e52b0b1</uuid>
Nov 10 22:55:52 user nova-compute[75288]:   <name>instance-00000024</name>
Nov 10 22:55:52 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:55:52 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:55:52 user nova-compute[75288]:   <metadata>
Nov 10 22:55:52 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:55:52 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:55:52 user nova-compute[75288]:       <nova:name>tempest-VolumesActionsTest-instance-370130682</nova:name>
Nov 10 22:55:52 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:55:52</nova:creationTime>
Nov 10 22:55:52 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:55:52 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:55:52 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:55:52 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:55:52 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:55:52 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:55:52 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:55:52 user nova-compute[75288]:       <nova:owner>
Nov 10 22:55:52 user nova-compute[75288]:         <nova:user uuid="8212f40024264c4d930417929bd14f96">tempest-VolumesActionsTest-92480672-project-member</nova:user>
Nov 10 22:55:52 user nova-compute[75288]:         <nova:project uuid="622aa0fa0ece481b88f19e55fe547117">tempest-VolumesActionsTest-92480672</nova:project>
Nov 10 22:55:52 user nova-compute[75288]:       </nova:owner>
Nov 10 22:55:52 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:55:52 user nova-compute[75288]:       <nova:ports>
Nov 10 22:55:52 user nova-compute[75288]:         <nova:port uuid="e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6">
Nov 10 22:55:52 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 22:55:52 user nova-compute[75288]:         </nova:port>
Nov 10 22:55:52 user nova-compute[75288]:       </nova:ports>
Nov 10 22:55:52 user nova-compute[75288]:     </nova:instance>
Nov 10 22:55:52 user nova-compute[75288]:   </metadata>
Nov 10 22:55:52 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:55:52 user nova-compute[75288]:     <system>
Nov 10 22:55:52 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:55:52 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:55:52 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:55:52 user nova-compute[75288]:       <entry name="serial">e00d0437-6c97-4100-9c9a-11e84e52b0b1</entry>
Nov 10 22:55:52 user nova-compute[75288]:       <entry name="uuid">e00d0437-6c97-4100-9c9a-11e84e52b0b1</entry>
Nov 10 22:55:52 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:55:52 user nova-compute[75288]:     </system>
Nov 10 22:55:52 user nova-compute[75288]:   </sysinfo>
Nov 10 22:55:52 user nova-compute[75288]:   <os>
Nov 10 22:55:52 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:55:52 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:55:52 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:55:52 user nova-compute[75288]:   </os>
Nov 10 22:55:52 user nova-compute[75288]:   <features>
Nov 10 22:55:52 user nova-compute[75288]:     <acpi/>
Nov 10 22:55:52 user nova-compute[75288]:     <apic/>
Nov 10 22:55:52 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:55:52 user nova-compute[75288]:   </features>
Nov 10 22:55:52 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:55:52 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:55:52 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:55:52 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:55:52 user nova-compute[75288]:   </clock>
Nov 10 22:55:52 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:55:52 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:55:52 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:55:52 user nova-compute[75288]:   </cpu>
Nov 10 22:55:52 user nova-compute[75288]:   <devices>
Nov 10 22:55:52 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:55:52 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:55:52 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk"/>
Nov 10 22:55:52 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:55:52 user nova-compute[75288]:     </disk>
Nov 10 22:55:52 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:55:52 user nova-compute[75288]:       <mac address="fa:16:3e:be:76:a9"/>
Nov 10 22:55:52 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:52 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:55:52 user nova-compute[75288]:       <target dev="tape786bd48-fe"/>
Nov 10 22:55:52 user nova-compute[75288]:     </interface>
Nov 10 22:55:52 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:55:52 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/console.log" append="off"/>
Nov 10 22:55:52 user nova-compute[75288]:     </serial>
Nov 10 22:55:52 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:55:52 user nova-compute[75288]:     <video>
Nov 10 22:55:52 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:52 user nova-compute[75288]:     </video>
Nov 10 22:55:52 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:55:52 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:55:52 user nova-compute[75288]:     </rng>
Nov 10 22:55:52 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:55:52 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:55:52 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:55:52 user nova-compute[75288]:     </memballoon>
Nov 10 22:55:52 user nova-compute[75288]:   </devices>
Nov 10 22:55:52 user nova-compute[75288]: </domain>
Nov 10 22:55:52 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-370130682',display_name='tempest-VolumesActionsTest-instance-370130682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-370130682',id=36,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622aa0fa0ece481b88f19e55fe547117',ramdisk_id='',reservation_id='r-0ppmctit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-92480672',owner_user_name='tempest-VolumesActionsTest-92480672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:55:51Z,user_data=None,user_id='8212f40024264c4d930417929bd14f96',uuid=e00d0437-6c97-4100-9c9a-11e84e52b0b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converting VIF {"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:76:a9,bridge_name='br-int',has_traffic_filtering=True,id=e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape786bd48-fe') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG os_vif [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:76:a9,bridge_name='br-int',has_traffic_filtering=True,id=e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape786bd48-fe') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcc0e388-cf86-5dcb-af1f-d78a47f1d637', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape786bd48-fe, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape786bd48-fe, col_values=(('qos', UUID('c47a2279-4df3-4838-bff2-1c4a065906b6')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape786bd48-fe, col_values=(('external_ids', {'iface-id': 'e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:76:a9', 'vm-uuid': 'e00d0437-6c97-4100-9c9a-11e84e52b0b1'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:52 user nova-compute[75288]: INFO os_vif [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:76:a9,bridge_name='br-int',has_traffic_filtering=True,id=e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape786bd48-fe')
Nov 10 22:55:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] No VIF found with MAC fa:16:3e:be:76:a9, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:55:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Updated VIF entry in instance network info cache for port e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:55:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Updating instance_info_cache with network_info: [{"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:55:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9712dc05-d9b6-412e-adc8-e2332a44fb03 req-5348fb96-e7df-4977-9e7f-40cde5711a91 service nova] Releasing lock "refresh_cache-e00d0437-6c97-4100-9c9a-11e84e52b0b1" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:55:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Creating image(s)
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Ensure instance console log exists: /opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Start _get_guest_xml network_info=[{"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23bd4722-1079-4562-998d-c2e7a77ae541', 'attached_at': '', 'detached_at': '', 'volume_id': '0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'serial': '0443cd30-ec8e-49c5-839d-f9b78fdc925c'}, 'mount_device': '/dev/vda', 'attachment_id': '4e6f0514-55bc-44f9-b82e-590f322fbffa', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:55:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:55:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:55:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:55:54 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f002d1a5-f392-49ba-bc34-0b06fd823eb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:55:54 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c83f88-b160-4ac2-a0e8-cc09fb4c3043]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c] added
Nov 10 22:55:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edbd339-b6db-4103-a695-dcb3d7ed4d16]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff14153-d4d6-421d-a2be-56f07742a2f8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzLKkwFu {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzLKkwFu" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[725d9edb-6940-464d-92f1-7502d8430245]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzLKkwFu'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94204b0-0730-48f1-9a1c-22ada8fb4b29]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee00af9d-d988-455a-ba64-9c3a637e627f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65221c0b-4dbf-45d5-a526-e792c2ea0a2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]
Nov 10 22:55:54 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.
Nov 10 22:55:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7817ae92-8676-4392-a30d-37f8eb519642]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abc0b88-5fa2-46f3-9f76-0008c87a3066]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:54 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:55:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:55:54 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:55:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f935b465-cb11-46d7-a514-b54bd7055eb2]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-ac76c841-7e02-4b08-a053-c714e352a6bd req-27669394-12ba-4a82-b667-709e3b64e367 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received event network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ac76c841-7e02-4b08-a053-c714e352a6bd req-27669394-12ba-4a82-b667-709e3b64e367 service nova] Acquiring lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ac76c841-7e02-4b08-a053-c714e352a6bd req-27669394-12ba-4a82-b667-709e3b64e367 service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ac76c841-7e02-4b08-a053-c714e352a6bd req-27669394-12ba-4a82-b667-709e3b64e367 service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-ac76c841-7e02-4b08-a053-c714e352a6bd req-27669394-12ba-4a82-b667-709e3b64e367 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] No waiting events found dispatching network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:54 user nova-compute[75288]: WARNING nova.compute.manager [req-ac76c841-7e02-4b08-a053-c714e352a6bd req-27669394-12ba-4a82-b667-709e3b64e367 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received unexpected event network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 for instance with vm_state building and task_state spawning.
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23632643334636230', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632643334636230', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-12392903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-12392903',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNEBN/sKvUakRElAQv0LqXfXSYlW+aA3xT1hBfSonnb3/AZ9eM3Jf9yQELxqwXxXoj+e+rqEkB5ZpjNNyqya4Bwh6avQ/qjhM186GUIEvmpsGmXT8Vb8aU1BtfwJpGw4Q==',key_name='tempest-keypair-1319776968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73708f6fd47643998393f71f7b66c828',ramdisk_id='',reservation_id='r-hnbsraog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-326920164',owner_user_name='tempest-ServerActionsV293TestJSON-326920164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73df74584ffb411cb7d360b1a28c04cc',uuid=23bd4722-1079-4562-998d-c2e7a77ae541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converting VIF {"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lazy-loading 'pci_devices' on Instance uuid 23bd4722-1079-4562-998d-c2e7a77ae541 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:55:55 user nova-compute[75288]:   <uuid>23bd4722-1079-4562-998d-c2e7a77ae541</uuid>
Nov 10 22:55:55 user nova-compute[75288]:   <name>instance-00000022</name>
Nov 10 22:55:55 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:55:55 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:55:55 user nova-compute[75288]:   <metadata>
Nov 10 22:55:55 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:55:55 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:55:55 user nova-compute[75288]:       <nova:name>tempest-ServerActionsV293TestJSON-server-12392903</nova:name>
Nov 10 22:55:55 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:55:54</nova:creationTime>
Nov 10 22:55:55 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:55:55 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:55:55 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:55:55 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:55:55 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:55:55 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:55:55 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:55:55 user nova-compute[75288]:       <nova:owner>
Nov 10 22:55:55 user nova-compute[75288]:         <nova:user uuid="73df74584ffb411cb7d360b1a28c04cc">tempest-ServerActionsV293TestJSON-326920164-project-member</nova:user>
Nov 10 22:55:55 user nova-compute[75288]:         <nova:project uuid="73708f6fd47643998393f71f7b66c828">tempest-ServerActionsV293TestJSON-326920164</nova:project>
Nov 10 22:55:55 user nova-compute[75288]:       </nova:owner>
Nov 10 22:55:55 user nova-compute[75288]:       <nova:ports>
Nov 10 22:55:55 user nova-compute[75288]:         <nova:port uuid="2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b">
Nov 10 22:55:55 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 22:55:55 user nova-compute[75288]:         </nova:port>
Nov 10 22:55:55 user nova-compute[75288]:       </nova:ports>
Nov 10 22:55:55 user nova-compute[75288]:     </nova:instance>
Nov 10 22:55:55 user nova-compute[75288]:   </metadata>
Nov 10 22:55:55 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:55:55 user nova-compute[75288]:     <system>
Nov 10 22:55:55 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:55:55 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:55:55 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:55:55 user nova-compute[75288]:       <entry name="serial">23bd4722-1079-4562-998d-c2e7a77ae541</entry>
Nov 10 22:55:55 user nova-compute[75288]:       <entry name="uuid">23bd4722-1079-4562-998d-c2e7a77ae541</entry>
Nov 10 22:55:55 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:55:55 user nova-compute[75288]:     </system>
Nov 10 22:55:55 user nova-compute[75288]:   </sysinfo>
Nov 10 22:55:55 user nova-compute[75288]:   <os>
Nov 10 22:55:55 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:55:55 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:55:55 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:55:55 user nova-compute[75288]:   </os>
Nov 10 22:55:55 user nova-compute[75288]:   <features>
Nov 10 22:55:55 user nova-compute[75288]:     <acpi/>
Nov 10 22:55:55 user nova-compute[75288]:     <apic/>
Nov 10 22:55:55 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:55:55 user nova-compute[75288]:   </features>
Nov 10 22:55:55 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:55:55 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:55:55 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:55:55 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:55:55 user nova-compute[75288]:   </clock>
Nov 10 22:55:55 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:55:55 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:55:55 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:55:55 user nova-compute[75288]:   </cpu>
Nov 10 22:55:55 user nova-compute[75288]:   <devices>
Nov 10 22:55:55 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:55:55 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:55:55 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Nov 10 22:55:55 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:55:55 user nova-compute[75288]:       <serial>0443cd30-ec8e-49c5-839d-f9b78fdc925c</serial>
Nov 10 22:55:55 user nova-compute[75288]:     </disk>
Nov 10 22:55:55 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:55:55 user nova-compute[75288]:       <mac address="fa:16:3e:bf:f9:21"/>
Nov 10 22:55:55 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:55 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:55:55 user nova-compute[75288]:       <target dev="tap2ca1fd66-ef"/>
Nov 10 22:55:55 user nova-compute[75288]:     </interface>
Nov 10 22:55:55 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:55:55 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541/console.log" append="off"/>
Nov 10 22:55:55 user nova-compute[75288]:     </serial>
Nov 10 22:55:55 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:55:55 user nova-compute[75288]:     <video>
Nov 10 22:55:55 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:55:55 user nova-compute[75288]:     </video>
Nov 10 22:55:55 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:55:55 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:55:55 user nova-compute[75288]:     </rng>
Nov 10 22:55:55 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:55:55 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:55:55 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:55:55 user nova-compute[75288]:     </memballoon>
Nov 10 22:55:55 user nova-compute[75288]:   </devices>
Nov 10 22:55:55 user nova-compute[75288]: </domain>
Nov 10 22:55:55 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-12392903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-12392903',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNEBN/sKvUakRElAQv0LqXfXSYlW+aA3xT1hBfSonnb3/AZ9eM3Jf9yQELxqwXxXoj+e+rqEkB5ZpjNNyqya4Bwh6avQ/qjhM186GUIEvmpsGmXT8Vb8aU1BtfwJpGw4Q==',key_name='tempest-keypair-1319776968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73708f6fd47643998393f71f7b66c828',ramdisk_id='',reservation_id='r-hnbsraog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-326920164',owner_user_name='tempest-ServerActionsV293TestJSON-326920164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73df74584ffb411cb7d360b1a28c04cc',uuid=23bd4722-1079-4562-998d-c2e7a77ae541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converting VIF {"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG os_vif [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c092c3dc-13af-5ddf-852a-a0b8442347d6', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ca1fd66-ef, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ca1fd66-ef, col_values=(('qos', UUID('640311ac-e1d1-4542-a1dc-1dca679e383b')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ca1fd66-ef, col_values=(('external_ids', {'iface-id': '2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:f9:21', 'vm-uuid': '23bd4722-1079-4562-998d-c2e7a77ae541'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:55 user nova-compute[75288]: INFO os_vif [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef')
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:55:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] No VIF found with MAC fa:16:3e:bf:f9:21, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:55:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-ff009449-27fa-42fe-bc9a-e9da9918da4c req-03553c21-34b1-4861-bf04-90a5781aa43a service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received event network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff009449-27fa-42fe-bc9a-e9da9918da4c req-03553c21-34b1-4861-bf04-90a5781aa43a service nova] Acquiring lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff009449-27fa-42fe-bc9a-e9da9918da4c req-03553c21-34b1-4861-bf04-90a5781aa43a service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff009449-27fa-42fe-bc9a-e9da9918da4c req-03553c21-34b1-4861-bf04-90a5781aa43a service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-ff009449-27fa-42fe-bc9a-e9da9918da4c req-03553c21-34b1-4861-bf04-90a5781aa43a service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] No waiting events found dispatching network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:56 user nova-compute[75288]: WARNING nova.compute.manager [req-ff009449-27fa-42fe-bc9a-e9da9918da4c req-03553c21-34b1-4861-bf04-90a5781aa43a service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received unexpected event network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 for instance with vm_state building and task_state spawning.
Nov 10 22:55:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:55:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Instance spawned successfully.
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-ee8df276-fcac-44ba-a743-b644d593dd5c req-c48b5baa-ad04-4275-af24-ef00c00b1135 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee8df276-fcac-44ba-a743-b644d593dd5c req-c48b5baa-ad04-4275-af24-ef00c00b1135 service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee8df276-fcac-44ba-a743-b644d593dd5c req-c48b5baa-ad04-4275-af24-ef00c00b1135 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee8df276-fcac-44ba-a743-b644d593dd5c req-c48b5baa-ad04-4275-af24-ef00c00b1135 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-ee8df276-fcac-44ba-a743-b644d593dd5c req-c48b5baa-ad04-4275-af24-ef00c00b1135 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:57 user nova-compute[75288]: WARNING nova.compute.manager [req-ee8df276-fcac-44ba-a743-b644d593dd5c req-c48b5baa-ad04-4275-af24-ef00c00b1135 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received unexpected event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with vm_state building and task_state spawning.
Nov 10 22:55:57 user nova-compute[75288]: INFO nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 10 22:55:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:55:57 user nova-compute[75288]: INFO nova.compute.manager [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Took 7.48 seconds to build instance.
Nov 10 22:55:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8c631eae-9a38-4887-8331-eadd777ff705 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.609s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:55:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 22:55:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 22:55:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance has had 2 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 22:55:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Deletion of /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize failed
Nov 10 22:55:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-eac05466-1457-4ae9-bdad-970774c9dca1 req-a834b6a7-c6e1-4150-9612-e6fc68a7150b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eac05466-1457-4ae9-bdad-970774c9dca1 req-a834b6a7-c6e1-4150-9612-e6fc68a7150b service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eac05466-1457-4ae9-bdad-970774c9dca1 req-a834b6a7-c6e1-4150-9612-e6fc68a7150b service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eac05466-1457-4ae9-bdad-970774c9dca1 req-a834b6a7-c6e1-4150-9612-e6fc68a7150b service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-eac05466-1457-4ae9-bdad-970774c9dca1 req-a834b6a7-c6e1-4150-9612-e6fc68a7150b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:55:59 user nova-compute[75288]: WARNING nova.compute.manager [req-eac05466-1457-4ae9-bdad-970774c9dca1 req-a834b6a7-c6e1-4150-9612-e6fc68a7150b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received unexpected event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with vm_state building and task_state spawning.
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:55:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance spawned successfully.
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:55:59 user nova-compute[75288]: INFO nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 10 22:55:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:55:59 user nova-compute[75288]: INFO nova.compute.manager [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Took 35.94 seconds to build instance.
Nov 10 22:55:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbaa7195-aaad-40fd-abf4-21957b8c9a66 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.041s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'flavor' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:26 user nova-compute[75288]: INFO nova.compute.manager [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Attaching volume e3feb2c9-716f-41dd-96d1-8c2c7e498f4e to /dev/vdb
Nov 10 22:56:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a105f-47d3-417c-b9e2-f99a680a2242]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7f10e9-089c-4fcf-9cc0-b5cd137981ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[80556025-ce03-4c8e-84a9-e8336a0801a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f00ed-56ca-4164-b739-516e77f2534c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:56:26 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:56:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f252082-4ab0-4202-a472-485add3746ef]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:56:26 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating existing volume attachment record: e3b3aba6-4587-4c2c-8469-841808ccb0af {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:56:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:56:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:56:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:56:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updating instance_info_cache with network_info: [{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:56:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:56:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7800MB free_disk=24.930484771728516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 60307487-1cfc-412f-86c8-994b8d9b47db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 23bd4722-1079-4562-998d-c2e7a77ae541 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 41f056ca-4cf8-423a-8a10-626d6091d835 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance e00d0437-6c97-4100-9c9a-11e84e52b0b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:56:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:56:37 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:56:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:56:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:37 user nova-compute[75288]: INFO nova.compute.manager [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Unrescuing
Nov 10 22:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:56:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'flavor' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-75530dc7-583c-423c-a2c0-eb5d17ae12d5 req-02195a71-aeac-4379-b3bf-1342c097dfee service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-75530dc7-583c-423c-a2c0-eb5d17ae12d5 req-02195a71-aeac-4379-b3bf-1342c097dfee service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-75530dc7-583c-423c-a2c0-eb5d17ae12d5 req-02195a71-aeac-4379-b3bf-1342c097dfee service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-75530dc7-583c-423c-a2c0-eb5d17ae12d5 req-02195a71-aeac-4379-b3bf-1342c097dfee service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-75530dc7-583c-423c-a2c0-eb5d17ae12d5 req-02195a71-aeac-4379-b3bf-1342c097dfee service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:56:38 user nova-compute[75288]: WARNING nova.compute.manager [req-75530dc7-583c-423c-a2c0-eb5d17ae12d5 req-02195a71-aeac-4379-b3bf-1342c097dfee service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:56:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance destroyed successfully.
Nov 10 22:56:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:56:40 user nova-compute[75288]: WARNING nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:56:40 user nova-compute[75288]: WARNING nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:56:40 user nova-compute[75288]: WARNING nova.compute.manager [req-c2407496-f7cf-40a9-ae97-cd419d1c8ed6 req-28d97c93-ff50-4509-a1a4-60445f9da42c service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-abe9d559-48e7-4c16-934c-0cd03d1e582f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:56:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:56:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:56:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbwtjELC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:56:52 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:56:52 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:56:52 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54512439-1eea-4dde-966c-052a356ad7fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:56:52 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[547f9bd7-2347-4805-a451-555b22c57694]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e] added
Nov 10 22:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1c6cd-78df-4b18-983b-f8eaff29ce9e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cfdd9a-185b-4d5c-91f1-eb78d7b5e8c6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbwtjELC {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbwtjELC" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e215c1-d098-4bb9-bf13-c21ab1fbbdab]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nbwtjELC'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d4d3ac-a079-4cea-8c7d-ba21db39aa81]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fdc75e-de93-4d7a-b346-fab939d639a8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:56:52 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:56:52 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6a3a39-f496-4866-9695-20151f29202c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]
Nov 10 22:56:52 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.
Nov 10 22:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[babfc3cf-3298-4add-8cb8-cb2f5721aff9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710a25a-9f31-4d7f-a488-4e7646e80b40]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:56:52 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:56:52 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:56:52 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:56:52 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[68355dc8-6063-4904-afdf-45f3038e8bf0]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbwtjELC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23631386561386139', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631386561386139', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'flavor' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:56:53 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:56:53 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 22:56:53 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:56:53 user nova-compute[75288]:   <serial>e3feb2c9-716f-41dd-96d1-8c2c7e498f4e</serial>
Nov 10 22:56:53 user nova-compute[75288]: </disk>
Nov 10 22:56:53 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No VIF found with MAC fa:16:3e:b9:50:33, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:56:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bfa368-afbf-4ec7-adac-3629db996ad9 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.457s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:56:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:56:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing instance network info cache due to event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] Acquiring lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] Acquired lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updated VIF entry in instance network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG nova.network.neutron [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-325c05f0-f09a-473f-824d-2718ca7d0620 req-d12294c0-5558-4aef-a440-bf96dc1a3821 service nova] Releasing lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing instance network info cache due to event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:57:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] Acquiring lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] Acquired lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:57:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updated VIF entry in instance network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:57:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c227f334-3037-4539-ae23-c92bcb795f41 req-0f36d629-4ee2-48b0-9482-f83ffe83a1b6 service nova] Releasing lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-changed-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Refreshing instance network info cache due to event network-changed-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] Acquiring lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] Acquired lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Refreshing network info cache for port 2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updated VIF entry in instance network info cache for port 2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updating instance_info_cache with network_info: [{"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a9bb33c-9ac9-47fc-9ed8-bfa73f711644 req-f04d5865-017d-40cf-988b-22f1c19b8e76 service nova] Releasing lock "refresh_cache-23bd4722-1079-4562-998d-c2e7a77ae541" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:15 user nova-compute[75288]: INFO nova.compute.manager [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Rebuilding instance
Nov 10 22:57:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca975e78-44f0-48f4-8808-4e91c8fd887d req-b9e7f132-79d8-4231-9629-495dc9963666 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-unplugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca975e78-44f0-48f4-8808-4e91c8fd887d req-b9e7f132-79d8-4231-9629-495dc9963666 service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca975e78-44f0-48f4-8808-4e91c8fd887d req-b9e7f132-79d8-4231-9629-495dc9963666 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca975e78-44f0-48f4-8808-4e91c8fd887d req-b9e7f132-79d8-4231-9629-495dc9963666 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca975e78-44f0-48f4-8808-4e91c8fd887d req-b9e7f132-79d8-4231-9629-495dc9963666 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-unplugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:16 user nova-compute[75288]: WARNING nova.compute.manager [req-ca975e78-44f0-48f4-8808-4e91c8fd887d req-b9e7f132-79d8-4231-9629-495dc9963666 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received unexpected event network-vif-unplugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with vm_state active and task_state rebuilding.
Nov 10 22:57:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance destroyed successfully.
Nov 10 22:57:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance destroyed successfully.
Nov 10 22:57:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227398108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-12392903',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNEBN/sKvUakRElAQv0LqXfXSYlW+aA3xT1hBfSonnb3/AZ9eM3Jf9yQELxqwXxXoj+e+rqEkB5ZpjNNyqya4Bwh6avQ/qjhM186GUIEvmpsGmXT8Vb8aU1BtfwJpGw4Q==',key_name='tempest-keypair-1319776968',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73708f6fd47643998393f71f7b66c828',ramdisk_id='',reservation_id='r-hnbsraog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-326920164',owner_user_name='tempest-ServerActionsV293TestJSON-326920164-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73df74584ffb411cb7d360b1a28c04cc',uuid=23bd4722-1079-4562-998d-c2e7a77ae541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converting VIF {"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_vif [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ca1fd66-ef, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=640311ac-e1d1-4542-a1dc-1dca679e383b) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:16 user nova-compute[75288]: INFO os_vif [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef')
Nov 10 22:57:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:57:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[13649e08-cfff-42d2-8e7f-4fd37f6bd145]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:57:16 user nova-compute[75288]: No targets found.
Nov 10 22:57:16 user nova-compute[75288]: iSNS:
Nov 10 22:57:16 user nova-compute[75288]: No targets found.
Nov 10 22:57:16 user nova-compute[75288]: STATIC:
Nov 10 22:57:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d
Nov 10 22:57:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:57:16 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:57:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e
Nov 10 22:57:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:57:16 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:57:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c
Nov 10 22:57:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:57:16 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:57:16 user nova-compute[75288]: FIRMWARE:
Nov 10 22:57:16 user nova-compute[75288]: No targets found.
Nov 10 22:57:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:57:16 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:57:16 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d514c31-10d0-43aa-b3ca-51b224f7628a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a48b6-cf4f-46b3-aa98-afcaad78e663]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:16 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:57:16 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:16 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:57:16 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b101c1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e82db8-61de-4b1a-a62b-0c18b7d2ee6c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e77978-c9ef-4409-b78e-e1ba43031835]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd06c6d7-6c9d-4ed3-9c2a-1c2cf839dccb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bbc4c8-9b07-4ad6-bc63-e927b7211b73]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1c5e1764', '/dev/disk/by-id/scsi-1SCST_BIO1c5e1764-62d34cb0b7fa7bfc', '/dev/disk/by-id/scsi-23632643334636230') {{(pid=86709) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[625685b0-b124-46d8-b34a-57591c066f5c]: (4, None) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[605b5b51-e807-4157-927d-d8d95506ac9f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[def3aea1-8a63-41ea-a719-58125f475dbc]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]
Nov 10 22:57:17 user nova-compute[75288]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.
Nov 10 22:57:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b65b5-188f-4d44-82cc-fd3f393b70ac]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] <== disconnect_volume: return (340ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:57:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Deleting instance files /opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541_del
Nov 10 22:57:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Deletion of /opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541_del complete
Nov 10 22:57:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 23bd4722-1079-4562-998d-c2e7a77ae541 could not be found.
Nov 10 22:57:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:57:17 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[231fa1c5-b5d9-41c5-8c88-b86fd8dae284]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:57:17 user nova-compute[75288]: No targets found.
Nov 10 22:57:17 user nova-compute[75288]: iSNS:
Nov 10 22:57:17 user nova-compute[75288]: No targets found.
Nov 10 22:57:17 user nova-compute[75288]: STATIC:
Nov 10 22:57:17 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d
Nov 10 22:57:17 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:57:17 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:57:17 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e
Nov 10 22:57:17 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:57:17 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:57:17 user nova-compute[75288]: FIRMWARE:
Nov 10 22:57:17 user nova-compute[75288]: No targets found.
Nov 10 22:57:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:57:17 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:57:17 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a520f79d-fcc3-411a-974b-a49fa6fc595f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a39b8f-a472-4867-8366-37bcef74e273]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:17 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:17 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b2850a710>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] <== disconnect_volume: return (90ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:57:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:57:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-336a258f-2d92-49ea-866e-730f5c0ba506 req-fd38d9b4-450b-4871-a806-75399f12aaf3 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-336a258f-2d92-49ea-866e-730f5c0ba506 req-fd38d9b4-450b-4871-a806-75399f12aaf3 service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-336a258f-2d92-49ea-866e-730f5c0ba506 req-fd38d9b4-450b-4871-a806-75399f12aaf3 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-336a258f-2d92-49ea-866e-730f5c0ba506 req-fd38d9b4-450b-4871-a806-75399f12aaf3 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-336a258f-2d92-49ea-866e-730f5c0ba506 req-fd38d9b4-450b-4871-a806-75399f12aaf3 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:18 user nova-compute[75288]: WARNING nova.compute.manager [req-336a258f-2d92-49ea-866e-730f5c0ba506 req-fd38d9b4-450b-4871-a806-75399f12aaf3 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received unexpected event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with vm_state active and task_state rebuilding.
Nov 10 22:57:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Preparing to wait for external event volume-reimaged-0443cd30-ec8e-49c5-839d-f9b78fdc925c {{(pid=75288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 10 22:57:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:25 user nova-compute[75288]: INFO nova.compute.manager [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Rebooting instance
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquired lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Releasing lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-7c3411dc-1dfb-42a9-8c68-31190def6794 req-c4e63e4f-2800-434e-b454-d3efc039aa99 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-unplugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7c3411dc-1dfb-42a9-8c68-31190def6794 req-c4e63e4f-2800-434e-b454-d3efc039aa99 service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7c3411dc-1dfb-42a9-8c68-31190def6794 req-c4e63e4f-2800-434e-b454-d3efc039aa99 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7c3411dc-1dfb-42a9-8c68-31190def6794 req-c4e63e4f-2800-434e-b454-d3efc039aa99 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-7c3411dc-1dfb-42a9-8c68-31190def6794 req-c4e63e4f-2800-434e-b454-d3efc039aa99 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-unplugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:25 user nova-compute[75288]: WARNING nova.compute.manager [req-7c3411dc-1dfb-42a9-8c68-31190def6794 req-c4e63e4f-2800-434e-b454-d3efc039aa99 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received unexpected event network-vif-unplugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 22:57:26 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance destroyed successfully.
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'resources' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-707260519',display_name='tempest-TestMinimumBasicScenario-server-707260519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-707260519',id=33,image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAnycqgamJwND3ivFUe2jrg9RcTBb7FqWtujrWk9V0BByF54ALcpf7Ow0h3nUkotkz/DSyNhh4DzVfVP+E248pNersZ8Xnr3f9sUZnvgnpL84DE4/3hM1icjyay/OSXNQ==',key_name='tempest-TestMinimumBasicScenario-817919814',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-z5nhbbqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:57:26Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=60307487-1cfc-412f-86c8-994b8d9b47db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_vif [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8608898a-94, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33e1cb5b-87e7-4bf5-9714-bce334b61063) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:26 user nova-compute[75288]: INFO os_vif [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94')
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbwtjELC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:57:26 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[898ca2b2-0d0c-4c85-a82f-62e93bda3ed7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:57:26 user nova-compute[75288]: No targets found.
Nov 10 22:57:26 user nova-compute[75288]: iSNS:
Nov 10 22:57:26 user nova-compute[75288]: No targets found.
Nov 10 22:57:26 user nova-compute[75288]: STATIC:
Nov 10 22:57:26 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d
Nov 10 22:57:26 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:57:26 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:57:26 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e
Nov 10 22:57:26 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:57:26 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:57:26 user nova-compute[75288]: FIRMWARE:
Nov 10 22:57:26 user nova-compute[75288]: No targets found.
Nov 10 22:57:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:57:26 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:57:26 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34413b-4193-43ee-be37-da5f7e95e743]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe58a1-f74b-4de8-aca7-5cf023103c32]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:26 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:26 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b101a5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f49bb5-e316-4d8d-a320-71eac192374a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0631497-0264-47a5-bdc6-7aa2f989f079]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc8efce-d375-4c2a-ac5d-978ffdedabf3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fd4684-73c5-4c1e-ac11-c0b2f9f8609a]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a879bc-12d5-46c6-9e0a-45d2c79a8d33]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1119cdb-15ac-4c27-840e-f2cc3692469c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]
Nov 10 22:57:26 user nova-compute[75288]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.
Nov 10 22:57:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8599d25f-2f61-4cc1-93f4-aeb89702238d]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== disconnect_volume: return (298ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Start _get_guest_xml network_info=[{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e308fd24-621c-4d7b-86e9-9d9c313386b0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'e308fd24-621c-4d7b-86e9-9d9c313386b0'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbwtjELC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '60307487-1cfc-412f-86c8-994b8d9b47db', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'serial': 'e3feb2c9-716f-41dd-96d1-8c2c7e498f4e'}, 'mount_device': '/dev/vdb', 'attachment_id': 'e3b3aba6-4587-4c2c-8469-841808ccb0af', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:57:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:57:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e308fd24-621c-4d7b-86e9-9d9c313386b0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.objects.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Object Instance<60307487-1cfc-412f-86c8-994b8d9b47db> lazy-loaded attributes: resources,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbwtjELC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:57:26 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:57:26 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:57:26 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6f07b2-f3a5-4e3b-a4b2-29ed5f7efefb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:57:26 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b10687-7e56-4fe6-9145-208acbcbd9d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e] added
Nov 10 22:57:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dddea5-885e-4faf-82e5-1ad92a835c4f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a6bc3-a391-40be-9c10-f18d7fac8c20]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbwtjELC {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbwtjELC" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0870a40-65d0-4515-963e-0534cfa130eb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nbwtjELC'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef788a-1071-42ee-9f26-c3ef40f28a04]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7074f3-9f37-42b4-99e7-059361f091e1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f05f5a-356e-4565-81a1-d446d4d81c4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]
Nov 10 22:57:27 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.
Nov 10 22:57:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be31eef7-3243-4074-94d7-8ab204060879]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497733f-bd4c-461f-b2d9-451025a27c35]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:27 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:57:27 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:57:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2364de52-6ee1-4f3c-b517-4a5461df9a7b]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-ebb0d46a-6b29-498a-9638-e77cf370abbc req-0c62f2d2-c38a-4c62-b49e-065c295fa901 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ebb0d46a-6b29-498a-9638-e77cf370abbc req-0c62f2d2-c38a-4c62-b49e-065c295fa901 service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ebb0d46a-6b29-498a-9638-e77cf370abbc req-0c62f2d2-c38a-4c62-b49e-065c295fa901 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ebb0d46a-6b29-498a-9638-e77cf370abbc req-0c62f2d2-c38a-4c62-b49e-065c295fa901 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-ebb0d46a-6b29-498a-9638-e77cf370abbc req-0c62f2d2-c38a-4c62-b49e-065c295fa901 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:27 user nova-compute[75288]: WARNING nova.compute.manager [req-ebb0d46a-6b29-498a-9638-e77cf370abbc req-0c62f2d2-c38a-4c62-b49e-065c295fa901 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received unexpected event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 22:57:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbwtjELC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23631386561386139', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631386561386139', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-707260519',display_name='tempest-TestMinimumBasicScenario-server-707260519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-707260519',id=33,image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAnycqgamJwND3ivFUe2jrg9RcTBb7FqWtujrWk9V0BByF54ALcpf7Ow0h3nUkotkz/DSyNhh4DzVfVP+E248pNersZ8Xnr3f9sUZnvgnpL84DE4/3hM1icjyay/OSXNQ==',key_name='tempest-TestMinimumBasicScenario-817919814',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-z5nhbbqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:57:26Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=60307487-1cfc-412f-86c8-994b8d9b47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'pci_devices' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.objects.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Object Instance<60307487-1cfc-412f-86c8-994b8d9b47db> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:57:28 user nova-compute[75288]:   <uuid>60307487-1cfc-412f-86c8-994b8d9b47db</uuid>
Nov 10 22:57:28 user nova-compute[75288]:   <name>instance-00000021</name>
Nov 10 22:57:28 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:57:28 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:57:28 user nova-compute[75288]:   <metadata>
Nov 10 22:57:28 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:57:28 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:57:28 user nova-compute[75288]:       <nova:name>tempest-TestMinimumBasicScenario-server-707260519</nova:name>
Nov 10 22:57:28 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:57:26</nova:creationTime>
Nov 10 22:57:28 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:57:28 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:57:28 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:57:28 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:57:28 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:57:28 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:57:28 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:57:28 user nova-compute[75288]:       <nova:owner>
Nov 10 22:57:28 user nova-compute[75288]:         <nova:user uuid="f86919732056405e8f8da616270f2672">tempest-TestMinimumBasicScenario-519527003-project-member</nova:user>
Nov 10 22:57:28 user nova-compute[75288]:         <nova:project uuid="0485db81ce8748b1b2bf3b8e907cdc5a">tempest-TestMinimumBasicScenario-519527003</nova:project>
Nov 10 22:57:28 user nova-compute[75288]:       </nova:owner>
Nov 10 22:57:28 user nova-compute[75288]:       <nova:root type="image" uuid="e308fd24-621c-4d7b-86e9-9d9c313386b0"/>
Nov 10 22:57:28 user nova-compute[75288]:       <nova:ports>
Nov 10 22:57:28 user nova-compute[75288]:         <nova:port uuid="8608898a-9485-46c2-9f58-d8aaf19f2ad3">
Nov 10 22:57:28 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 22:57:28 user nova-compute[75288]:         </nova:port>
Nov 10 22:57:28 user nova-compute[75288]:       </nova:ports>
Nov 10 22:57:28 user nova-compute[75288]:     </nova:instance>
Nov 10 22:57:28 user nova-compute[75288]:   </metadata>
Nov 10 22:57:28 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:57:28 user nova-compute[75288]:     <system>
Nov 10 22:57:28 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:57:28 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:57:28 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:57:28 user nova-compute[75288]:       <entry name="serial">60307487-1cfc-412f-86c8-994b8d9b47db</entry>
Nov 10 22:57:28 user nova-compute[75288]:       <entry name="uuid">60307487-1cfc-412f-86c8-994b8d9b47db</entry>
Nov 10 22:57:28 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:57:28 user nova-compute[75288]:     </system>
Nov 10 22:57:28 user nova-compute[75288]:   </sysinfo>
Nov 10 22:57:28 user nova-compute[75288]:   <os>
Nov 10 22:57:28 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:57:28 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:57:28 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:57:28 user nova-compute[75288]:   </os>
Nov 10 22:57:28 user nova-compute[75288]:   <features>
Nov 10 22:57:28 user nova-compute[75288]:     <acpi/>
Nov 10 22:57:28 user nova-compute[75288]:     <apic/>
Nov 10 22:57:28 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:57:28 user nova-compute[75288]:   </features>
Nov 10 22:57:28 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:57:28 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:57:28 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:57:28 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:57:28 user nova-compute[75288]:   </clock>
Nov 10 22:57:28 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:57:28 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:57:28 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:57:28 user nova-compute[75288]:   </cpu>
Nov 10 22:57:28 user nova-compute[75288]:   <devices>
Nov 10 22:57:28 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:57:28 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:57:28 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk"/>
Nov 10 22:57:28 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:57:28 user nova-compute[75288]:     </disk>
Nov 10 22:57:28 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:57:28 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:57:28 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Nov 10 22:57:28 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 22:57:28 user nova-compute[75288]:       <serial>e3feb2c9-716f-41dd-96d1-8c2c7e498f4e</serial>
Nov 10 22:57:28 user nova-compute[75288]:     </disk>
Nov 10 22:57:28 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:57:28 user nova-compute[75288]:       <mac address="fa:16:3e:b9:50:33"/>
Nov 10 22:57:28 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:57:28 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:57:28 user nova-compute[75288]:       <target dev="tap8608898a-94"/>
Nov 10 22:57:28 user nova-compute[75288]:     </interface>
Nov 10 22:57:28 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:57:28 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/console.log" append="off"/>
Nov 10 22:57:28 user nova-compute[75288]:     </serial>
Nov 10 22:57:28 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:57:28 user nova-compute[75288]:     <video>
Nov 10 22:57:28 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:57:28 user nova-compute[75288]:     </video>
Nov 10 22:57:28 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:57:28 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:57:28 user nova-compute[75288]:     </rng>
Nov 10 22:57:28 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:57:28 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:57:28 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:57:28 user nova-compute[75288]:     </memballoon>
Nov 10 22:57:28 user nova-compute[75288]:   </devices>
Nov 10 22:57:28 user nova-compute[75288]: </domain>
Nov 10 22:57:28 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.objects.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Object Instance<60307487-1cfc-412f-86c8-994b8d9b47db> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Cannot resize image /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'migration_context' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.objects.base [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Object Instance<60307487-1cfc-412f-86c8-994b8d9b47db> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-707260519',display_name='tempest-TestMinimumBasicScenario-server-707260519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-707260519',id=33,image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAnycqgamJwND3ivFUe2jrg9RcTBb7FqWtujrWk9V0BByF54ALcpf7Ow0h3nUkotkz/DSyNhh4DzVfVP+E248pNersZ8Xnr3f9sUZnvgnpL84DE4/3hM1icjyay/OSXNQ==',key_name='tempest-TestMinimumBasicScenario-817919814',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-z5nhbbqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:57:26Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=60307487-1cfc-412f-86c8-994b8d9b47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG os_vif [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5e5d75b-f6c6-5634-b342-07eb108621ee', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8608898a-94, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8608898a-94, col_values=(('qos', UUID('45e04da0-98ef-4f3a-8ec4-c7e251cb98db')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8608898a-94, col_values=(('external_ids', {'iface-id': '8608898a-9485-46c2-9f58-d8aaf19f2ad3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:50:33', 'vm-uuid': '60307487-1cfc-412f-86c8-994b8d9b47db'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:28 user nova-compute[75288]: INFO os_vif [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94')
Nov 10 22:57:30 user nova-compute[75288]: INFO nova.compute.manager [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Unrescuing
Nov 10 22:57:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-89b04723-0b38-4e42-9e19-5dd43c6e42c1 req-0bba5999-39af-4c12-831f-63ed46ea312f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-89b04723-0b38-4e42-9e19-5dd43c6e42c1 req-0bba5999-39af-4c12-831f-63ed46ea312f service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-89b04723-0b38-4e42-9e19-5dd43c6e42c1 req-0bba5999-39af-4c12-831f-63ed46ea312f service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-89b04723-0b38-4e42-9e19-5dd43c6e42c1 req-0bba5999-39af-4c12-831f-63ed46ea312f service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-89b04723-0b38-4e42-9e19-5dd43c6e42c1 req-0bba5999-39af-4c12-831f-63ed46ea312f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:30 user nova-compute[75288]: WARNING nova.compute.manager [req-89b04723-0b38-4e42-9e19-5dd43c6e42c1 req-0bba5999-39af-4c12-831f-63ed46ea312f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received unexpected event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 22:57:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'flavor' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-566ddbb6-e8f7-402c-9fa4-d54788ce4e9c req-e64d9324-7a25-460b-9926-da2d780df993 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-566ddbb6-e8f7-402c-9fa4-d54788ce4e9c req-e64d9324-7a25-460b-9926-da2d780df993 service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-566ddbb6-e8f7-402c-9fa4-d54788ce4e9c req-e64d9324-7a25-460b-9926-da2d780df993 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-566ddbb6-e8f7-402c-9fa4-d54788ce4e9c req-e64d9324-7a25-460b-9926-da2d780df993 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-566ddbb6-e8f7-402c-9fa4-d54788ce4e9c req-e64d9324-7a25-460b-9926-da2d780df993 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:31 user nova-compute[75288]: WARNING nova.compute.manager [req-566ddbb6-e8f7-402c-9fa4-d54788ce4e9c req-e64d9324-7a25-460b-9926-da2d780df993 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing instance network info cache due to event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.network.neutron [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:57:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance destroyed successfully.
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.network.neutron [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updated VIF entry in instance network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.network.neutron [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-70890187-86e5-4fce-84c4-a718bfb85400 req-f32cd3e8-cec8-4583-a384-e6136c3eec12 service nova] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:57:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance rebooted successfully.
Nov 10 22:57:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b1d4272-f2da-4f93-9320-7e2e026dada8 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.502s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-1ef40a47-26d6-4832-b3ff-41e1ce080578 req-269b1f82-9163-41d3-a9ee-b2bb5e7b02c5 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ef40a47-26d6-4832-b3ff-41e1ce080578 req-269b1f82-9163-41d3-a9ee-b2bb5e7b02c5 service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ef40a47-26d6-4832-b3ff-41e1ce080578 req-269b1f82-9163-41d3-a9ee-b2bb5e7b02c5 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ef40a47-26d6-4832-b3ff-41e1ce080578 req-269b1f82-9163-41d3-a9ee-b2bb5e7b02c5 service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-1ef40a47-26d6-4832-b3ff-41e1ce080578 req-269b1f82-9163-41d3-a9ee-b2bb5e7b02c5 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:32 user nova-compute[75288]: WARNING nova.compute.manager [req-1ef40a47-26d6-4832-b3ff-41e1ce080578 req-269b1f82-9163-41d3-a9ee-b2bb5e7b02c5 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received unexpected event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with vm_state active and task_state None.
Nov 10 22:57:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:33 user nova-compute[75288]: WARNING nova.compute.manager [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:33 user nova-compute[75288]: WARNING nova.compute.manager [req-811aee95-8714-4c1e-ab04-3b4db6d60a33 req-778832f9-a3aa-4c80-b37e-31ea5b69dd1d service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing instance network info cache due to event network-changed-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] Acquiring lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] Acquired lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Refreshing network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:57:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updated VIF entry in instance network info cache for port fc3f6fa3-d1c2-4c8b-a442-15071214b6c8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [{"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d3d1cd8e-b44c-4dee-bc5f-76449644d0e0 req-026b7ad9-6f41-4393-8b89-20cc6539e70b service nova] Releasing lock "refresh_cache-04509269-e685-4bdb-8663-6c4a27fb8169" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-changed-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Refreshing instance network info cache due to event network-changed-00dde69e-52cb-4abc-899b-927901184704. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] Acquiring lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] Acquired lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:57:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Refreshing network info cache for port 00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updated VIF entry in instance network info cache for port 00dde69e-52cb-4abc-899b-927901184704. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updating instance_info_cache with network_info: [{"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-255da1b1-179a-4f76-94da-1d3060f945bc req-2a059f1e-0dcf-42e8-9864-0da553770f0b service nova] Releasing lock "refresh_cache-41f056ca-4cf8-423a-8a10-626d6091d835" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d988e23d-d90f-4711-a793-f123dbaac818 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5965a3b2-796d-45fe-aab2-92f08e9b3f4e req-8c520f95-72c4-46c2-9a68-20be8f96fc04 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5965a3b2-796d-45fe-aab2-92f08e9b3f4e req-8c520f95-72c4-46c2-9a68-20be8f96fc04 service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5965a3b2-796d-45fe-aab2-92f08e9b3f4e req-8c520f95-72c4-46c2-9a68-20be8f96fc04 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5965a3b2-796d-45fe-aab2-92f08e9b3f4e req-8c520f95-72c4-46c2-9a68-20be8f96fc04 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-5965a3b2-796d-45fe-aab2-92f08e9b3f4e req-8c520f95-72c4-46c2-9a68-20be8f96fc04 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:35 user nova-compute[75288]: WARNING nova.compute.manager [req-5965a3b2-796d-45fe-aab2-92f08e9b3f4e req-8c520f95-72c4-46c2-9a68-20be8f96fc04 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'flavor' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:36 user nova-compute[75288]: INFO nova.compute.manager [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Attaching volume 3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 to /dev/vdb
Nov 10 22:57:36 user nova-compute[75288]: DEBUG os_brick.utils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[728df7f9-e883-4b9c-a2c8-762fe705994b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[911ebf22-cf53-4f9d-8f99-2c05ed6690f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7c0e4-17d7-418e-9902-2dafec207a3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0f50e-4eb1-47cc-a607-df146c1a62af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:57:37 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f11394-f059-49c9-8ba3-47f3189a6cfa]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updating existing volume attachment record: e70f16a0-0f4d-4645-8469-27cfe5a46849 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:57:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:57:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8166MB free_disk=24.925140380859375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 60307487-1cfc-412f-86c8-994b8d9b47db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 23bd4722-1079-4562-998d-c2e7a77ae541 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 41f056ca-4cf8-423a-8a10-626d6091d835 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance e00d0437-6c97-4100-9c9a-11e84e52b0b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:57:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:57:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:57:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:40 user nova-compute[75288]: INFO nova.compute.manager [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Terminating instance
Nov 10 22:57:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-3d43139d-17c8-4d24-a941-a6ec3b2c367f req-fd2f9599-aa28-49ee-8682-67e7b6cb1506 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received event network-vif-unplugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3d43139d-17c8-4d24-a941-a6ec3b2c367f req-fd2f9599-aa28-49ee-8682-67e7b6cb1506 service nova] Acquiring lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3d43139d-17c8-4d24-a941-a6ec3b2c367f req-fd2f9599-aa28-49ee-8682-67e7b6cb1506 service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.016s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3d43139d-17c8-4d24-a941-a6ec3b2c367f req-fd2f9599-aa28-49ee-8682-67e7b6cb1506 service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-3d43139d-17c8-4d24-a941-a6ec3b2c367f req-fd2f9599-aa28-49ee-8682-67e7b6cb1506 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] No waiting events found dispatching network-vif-unplugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-3d43139d-17c8-4d24-a941-a6ec3b2c367f req-fd2f9599-aa28-49ee-8682-67e7b6cb1506 service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received event network-vif-unplugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Instance destroyed successfully.
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lazy-loading 'resources' on Instance uuid e00d0437-6c97-4100-9c9a-11e84e52b0b1 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-370130682',display_name='tempest-VolumesActionsTest-instance-370130682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-370130682',id=36,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622aa0fa0ece481b88f19e55fe547117',ramdisk_id='',reservation_id='r-0ppmctit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-92480672',owner_user_name='tempest-VolumesActionsTest-92480672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:55:58Z,user_data=None,user_id='8212f40024264c4d930417929bd14f96',uuid=e00d0437-6c97-4100-9c9a-11e84e52b0b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converting VIF {"id": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "address": "fa:16:3e:be:76:a9", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape786bd48-fe", "ovs_interfaceid": "e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:76:a9,bridge_name='br-int',has_traffic_filtering=True,id=e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape786bd48-fe') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG os_vif [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:76:a9,bridge_name='br-int',has_traffic_filtering=True,id=e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape786bd48-fe') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape786bd48-fe, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c47a2279-4df3-4838-bff2-1c4a065906b6) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:57:41 user nova-compute[75288]: INFO os_vif [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:76:a9,bridge_name='br-int',has_traffic_filtering=True,id=e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape786bd48-fe')
Nov 10 22:57:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Deleting instance files /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1_del
Nov 10 22:57:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Deletion of /opt/stack/data/nova/instances/e00d0437-6c97-4100-9c9a-11e84e52b0b1_del complete
Nov 10 22:57:41 user nova-compute[75288]: INFO nova.compute.manager [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:41 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Took 0.52 seconds to deallocate network for instance.
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:57:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:57:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:42 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Deleted allocations for instance e00d0437-6c97-4100-9c9a-11e84e52b0b1
Nov 10 22:57:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17ff79f6-6337-47b8-8079-22ff39c266ed tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ec4cc17f-6286-4223-bb4e-29668e5a4b20 req-2280c867-d400-48c6-9f6a-55f15a83744d service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received event network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ec4cc17f-6286-4223-bb4e-29668e5a4b20 req-2280c867-d400-48c6-9f6a-55f15a83744d service nova] Acquiring lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ec4cc17f-6286-4223-bb4e-29668e5a4b20 req-2280c867-d400-48c6-9f6a-55f15a83744d service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ec4cc17f-6286-4223-bb4e-29668e5a4b20 req-2280c867-d400-48c6-9f6a-55f15a83744d service nova] Lock "e00d0437-6c97-4100-9c9a-11e84e52b0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:57:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ec4cc17f-6286-4223-bb4e-29668e5a4b20 req-2280c867-d400-48c6-9f6a-55f15a83744d service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] No waiting events found dispatching network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:57:43 user nova-compute[75288]: WARNING nova.compute.manager [req-ec4cc17f-6286-4223-bb4e-29668e5a4b20 req-2280c867-d400-48c6-9f6a-55f15a83744d service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received unexpected event network-vif-plugged-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 for instance with vm_state deleted and task_state None.
Nov 10 22:57:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ec4cc17f-6286-4223-bb4e-29668e5a4b20 req-2280c867-d400-48c6-9f6a-55f15a83744d service nova] [instance: e00d0437-6c97-4100-9c9a-11e84e52b0b1] Received event network-vif-deleted-e786bd48-fe7b-46b2-945c-b7ddbf8ff2c6 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:57:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:57:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:57:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:57:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQPKwGhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:58:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:58:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:58:02 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f41f6d6-22fb-4943-84eb-24adf16d3147]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:58:02 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[13035077-e6d4-4d31-b64d-325d0685b953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5] added
Nov 10 22:58:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca4ec9-e915-4ca3-b980-63ef12e13242]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7371f105-ded4-41fb-be62-1ad7b00aabf1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQPKwGhZ {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQPKwGhZ" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2bd94-85fe-41da-94cf-ae742287ea59]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQPKwGhZ'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[681005ab-4ad6-44ec-a838-463725eb7543]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5eca01-074c-4faa-bfba-861e5f4d8163]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:58:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:58:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec93d6-a63a-4ede-942f-1cc2054ee82f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260]
Nov 10 22:58:02 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260] successful.
Nov 10 22:58:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23741ece-f0fa-4b61-bf57-555a7ec12f6c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[31af8b00-065e-482e-aeaa-398ac5f9042c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:58:02 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5de01f6-5c30-4ebd-8a8b-2f04b2a773c3]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:58:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQPKwGhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:03 user nova-compute[75288]: INFO nova.compute.manager [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Detaching volume f00340fd-af72-476f-8c0b-e6f988c88d6d
Nov 10 22:58:03 user nova-compute[75288]: INFO nova.virt.block_device [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Attempting to driver detach volume f00340fd-af72-476f-8c0b-e6f988c88d6d from mountpoint /dev/vdb
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Attempting to detach device vdb from instance 04509269-e685-4bdb-8663-6c4a27fb8169 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:58:03 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:58:03 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:58:03 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:58:03 user nova-compute[75288]:   <serial>f00340fd-af72-476f-8c0b-e6f988c88d6d</serial>
Nov 10 22:58:03 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:58:03 user nova-compute[75288]: </disk>
Nov 10 22:58:03 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:58:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Successfully detached device vdb from instance 04509269-e685-4bdb-8663-6c4a27fb8169 from the persistent domain config.
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04509269-e685-4bdb-8663-6c4a27fb8169 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:58:03 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:58:03 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:58:03 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:58:03 user nova-compute[75288]:   <serial>f00340fd-af72-476f-8c0b-e6f988c88d6d</serial>
Nov 10 22:58:03 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:58:03 user nova-compute[75288]: </disk>
Nov 10 22:58:03 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23231346336643637', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231346336643637', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'flavor' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:58:03 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:58:03 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:58:03 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:58:03 user nova-compute[75288]:   <serial>3e8cd4a7-e9ab-48b3-a163-184bd309a8a5</serial>
Nov 10 22:58:03 user nova-compute[75288]: </disk>
Nov 10 22:58:03 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:58:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:58:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No VIF found with MAC fa:16:3e:4d:4e:a0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:58:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b8c99aac-3dc5-4651-97e0-385a24a6a4ba tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.651s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'flavor' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:07 user nova-compute[75288]: INFO nova.compute.manager [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Attaching volume d1e8dbfa-2e00-4c96-b49d-2acc8b033854 to /dev/vdc
Nov 10 22:58:07 user nova-compute[75288]: DEBUG os_brick.utils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3fc91-2df6-4a18-abd9-1cc35d0b93d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fc25cd-2872-42e0-b0b4-d7a133f157f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba4e73-51ac-4f14-b677-916074054e8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[271a9dd8-0f1e-4a31-9d30-e00ff47dca55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:58:07 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:58:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b83a4-cd56-47d1-9962-144e386f93f5]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG os_brick.utils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:58:07 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updating existing volume attachment record: b7520ca4-c674-4fdd-bf0a-d336c217aba7 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:58:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 req-59334d99-9ea3-4b9f-9214-c62ef9ed355c service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event volume-reimaged-0443cd30-ec8e-49c5-839d-f9b78fdc925c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 req-59334d99-9ea3-4b9f-9214-c62ef9ed355c service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 req-59334d99-9ea3-4b9f-9214-c62ef9ed355c service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 req-59334d99-9ea3-4b9f-9214-c62ef9ed355c service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 req-59334d99-9ea3-4b9f-9214-c62ef9ed355c service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Processing event volume-reimaged-0443cd30-ec8e-49c5-839d-f9b78fdc925c {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance event wait completed in 47 seconds for volume-reimaged {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:58:10 user nova-compute[75288]: INFO nova.virt.block_device [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Booting with volume 0443cd30-ec8e-49c5-839d-f9b78fdc925c at /dev/vda
Nov 10 22:58:10 user nova-compute[75288]: DEBUG os_brick.utils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1237b1-4cdc-4de2-85cd-a1770e2ec074]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5de8440-e3f0-4c1e-954d-cc2b90149f6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c90c3-e5f6-4da8-b433-003fd6e59d00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e188efb2-634a-49e1-8c17-078de7b94c17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 22:58:10 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 22:58:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae8f88-f904-480c-a8d4-9750446ca00a]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG os_brick.utils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:58:10 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updating existing volume attachment record: db0b322c-4d00-4a6c-b2be-5dbb07337c20 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 22:58:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:58:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:58:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:58:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 04509269-e685-4bdb-8663-6c4a27fb8169 is timed out.
Nov 10 22:58:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Successfully detached device vdb from instance 04509269-e685-4bdb-8663-6c4a27fb8169 from the live domain config.
Nov 10 22:58:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRoJTqAb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:58:23 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:58:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1264c038-641a-49fa-ba99-03826069177c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:58:23 user nova-compute[75288]: No targets found.
Nov 10 22:58:23 user nova-compute[75288]: iSNS:
Nov 10 22:58:23 user nova-compute[75288]: No targets found.
Nov 10 22:58:23 user nova-compute[75288]: STATIC:
Nov 10 22:58:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d
Nov 10 22:58:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:58:23 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:58:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5
Nov 10 22:58:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:58:23 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:58:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e
Nov 10 22:58:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:58:23 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:58:23 user nova-compute[75288]: FIRMWARE:
Nov 10 22:58:23 user nova-compute[75288]: No targets found.
Nov 10 22:58:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:58:23 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:58:23 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd8e68a-60dc-4b44-973c-c208eca2192f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f40f98-5406-48a2-a733-7acbd90d2db2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:58:24 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:24 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d (non-flash)
Nov 10 22:58:24 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:24 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b203cd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e592a495-8392-4290-857d-13a5e0e4f47e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca472d-e4a7-41ff-a489-3f6f6547c771]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee1683-d2a5-4486-a44d-4c156bad9420]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdffe8a-c12e-4d1e-adb9-2fd2475407f5]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152839e-e686-477b-9a00-79247489c48a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b789c0ef-d540-4f90-81f5-55680cb0dadd]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260]
Nov 10 22:58:24 user nova-compute[75288]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d, portal: 172.16.0.220,3260] successful.
Nov 10 22:58:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f00340fd-af72-476f-8c0b-e6f988c88d6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc23f25-24f5-4d21-9963-f1033c7f0994]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] <== disconnect_volume: return (325ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:58:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:58:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:58:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:58:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:58:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:58:32 user nova-compute[75288]: INFO nova.compute.claims [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Claim successful on node user
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:58:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:58:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:58:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Creating image(s)
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "/opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "/opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.policy [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8212f40024264c4d930417929bd14f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622aa0fa0ece481b88f19e55fe547117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk 1073741824" returned: 0 in 0.052s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.232s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Skipping network cache update for instance because it is Building. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.network.neutron [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Successfully created port: 94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wleAxFPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:58:33 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:58:33 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:58:33 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Cannot resize image /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Ensure instance console log exists: /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a91aa1-7581-42ee-ab76-61113753681f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:58:33 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b37f7-b2b7-433d-9d13-66360c2417c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854] added
Nov 10 22:58:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fdb177-c219-4e50-ab95-062f5c27bec9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84bcd3a-21c9-42cb-8bb1-b8ff1e024cb0]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wleAxFPj {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wleAxFPj" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3db17-ee96-4887-9f41-25da7bdc37c5]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wleAxFPj'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ceaad4-60a0-4b7a-a6e8-f3b856356e9e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e96add-aa30-4d06-8ac3-dfb270dfb961]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:34 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:34 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[31696281-cf85-40de-8264-b1686a581b6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260]
Nov 10 22:58:34 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260] successful.
Nov 10 22:58:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3034668b-fbc8-481f-98bb-7e165360df8e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b08073c-dd32-40b3-bd32-7d45f85c06be]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:34 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:34 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:58:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:34 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:34 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:58:34 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5415c7-a73f-4a0a-aa05-8809144bed88]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wleAxFPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Successfully updated port: 94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "refresh_cache-5ca70dc3-84a3-4ba4-afe0-fde66b512357" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquired lock "refresh_cache-5ca70dc3-84a3-4ba4-afe0-fde66b512357" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received event network-changed-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Refreshing instance network info cache due to event network-changed-94340c9c-a9e1-4658-93a8-c5307e1ab718. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] Acquiring lock "refresh_cache-5ca70dc3-84a3-4ba4-afe0-fde66b512357" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Updating instance_info_cache with network_info: [{"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Releasing lock "refresh_cache-5ca70dc3-84a3-4ba4-afe0-fde66b512357" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Instance network_info: |[{"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] Acquired lock "refresh_cache-5ca70dc3-84a3-4ba4-afe0-fde66b512357" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Refreshing network info cache for port 94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Start _get_guest_xml network_info=[{"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:58:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:58:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1764689881',display_name='tempest-VolumesActionsTest-instance-1764689881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1764689881',id=37,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622aa0fa0ece481b88f19e55fe547117',ramdisk_id='',reservation_id='r-shnfogsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-92480672',owner_user_name='tempest-VolumesActionsTest-92480672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:58:33Z,user_data=None,user_id='8212f40024264c4d930417929bd14f96',uuid=5ca70dc3-84a3-4ba4-afe0-fde66b512357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converting VIF {"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:9c:1b,bridge_name='br-int',has_traffic_filtering=True,id=94340c9c-a9e1-4658-93a8-c5307e1ab718,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94340c9c-a9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ca70dc3-84a3-4ba4-afe0-fde66b512357 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:58:35 user nova-compute[75288]:   <uuid>5ca70dc3-84a3-4ba4-afe0-fde66b512357</uuid>
Nov 10 22:58:35 user nova-compute[75288]:   <name>instance-00000025</name>
Nov 10 22:58:35 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:58:35 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:58:35 user nova-compute[75288]:   <metadata>
Nov 10 22:58:35 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:58:35 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:58:35 user nova-compute[75288]:       <nova:name>tempest-VolumesActionsTest-instance-1764689881</nova:name>
Nov 10 22:58:35 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:58:35</nova:creationTime>
Nov 10 22:58:35 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:58:35 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:58:35 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:58:35 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:58:35 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:58:35 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:58:35 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:58:35 user nova-compute[75288]:       <nova:owner>
Nov 10 22:58:35 user nova-compute[75288]:         <nova:user uuid="8212f40024264c4d930417929bd14f96">tempest-VolumesActionsTest-92480672-project-member</nova:user>
Nov 10 22:58:35 user nova-compute[75288]:         <nova:project uuid="622aa0fa0ece481b88f19e55fe547117">tempest-VolumesActionsTest-92480672</nova:project>
Nov 10 22:58:35 user nova-compute[75288]:       </nova:owner>
Nov 10 22:58:35 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:58:35 user nova-compute[75288]:       <nova:ports>
Nov 10 22:58:35 user nova-compute[75288]:         <nova:port uuid="94340c9c-a9e1-4658-93a8-c5307e1ab718">
Nov 10 22:58:35 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 22:58:35 user nova-compute[75288]:         </nova:port>
Nov 10 22:58:35 user nova-compute[75288]:       </nova:ports>
Nov 10 22:58:35 user nova-compute[75288]:     </nova:instance>
Nov 10 22:58:35 user nova-compute[75288]:   </metadata>
Nov 10 22:58:35 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:58:35 user nova-compute[75288]:     <system>
Nov 10 22:58:35 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:58:35 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:58:35 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:58:35 user nova-compute[75288]:       <entry name="serial">5ca70dc3-84a3-4ba4-afe0-fde66b512357</entry>
Nov 10 22:58:35 user nova-compute[75288]:       <entry name="uuid">5ca70dc3-84a3-4ba4-afe0-fde66b512357</entry>
Nov 10 22:58:35 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:58:35 user nova-compute[75288]:     </system>
Nov 10 22:58:35 user nova-compute[75288]:   </sysinfo>
Nov 10 22:58:35 user nova-compute[75288]:   <os>
Nov 10 22:58:35 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:58:35 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:58:35 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:58:35 user nova-compute[75288]:   </os>
Nov 10 22:58:35 user nova-compute[75288]:   <features>
Nov 10 22:58:35 user nova-compute[75288]:     <acpi/>
Nov 10 22:58:35 user nova-compute[75288]:     <apic/>
Nov 10 22:58:35 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:58:35 user nova-compute[75288]:   </features>
Nov 10 22:58:35 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:58:35 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:58:35 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:58:35 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:58:35 user nova-compute[75288]:   </clock>
Nov 10 22:58:35 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:58:35 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:58:35 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:58:35 user nova-compute[75288]:   </cpu>
Nov 10 22:58:35 user nova-compute[75288]:   <devices>
Nov 10 22:58:35 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:58:35 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:58:35 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk"/>
Nov 10 22:58:35 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:58:35 user nova-compute[75288]:     </disk>
Nov 10 22:58:35 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:58:35 user nova-compute[75288]:       <mac address="fa:16:3e:f2:9c:1b"/>
Nov 10 22:58:35 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:58:35 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:58:35 user nova-compute[75288]:       <target dev="tap94340c9c-a9"/>
Nov 10 22:58:35 user nova-compute[75288]:     </interface>
Nov 10 22:58:35 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:58:35 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/console.log" append="off"/>
Nov 10 22:58:35 user nova-compute[75288]:     </serial>
Nov 10 22:58:35 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:58:35 user nova-compute[75288]:     <video>
Nov 10 22:58:35 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:58:35 user nova-compute[75288]:     </video>
Nov 10 22:58:35 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:58:35 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:58:35 user nova-compute[75288]:     </rng>
Nov 10 22:58:35 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:58:35 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:58:35 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:58:35 user nova-compute[75288]:     </memballoon>
Nov 10 22:58:35 user nova-compute[75288]:   </devices>
Nov 10 22:58:35 user nova-compute[75288]: </domain>
Nov 10 22:58:35 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1764689881',display_name='tempest-VolumesActionsTest-instance-1764689881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1764689881',id=37,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622aa0fa0ece481b88f19e55fe547117',ramdisk_id='',reservation_id='r-shnfogsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-92480672',owner_user_name='tempest-VolumesActionsTest-92480672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:58:33Z,user_data=None,user_id='8212f40024264c4d930417929bd14f96',uuid=5ca70dc3-84a3-4ba4-afe0-fde66b512357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converting VIF {"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:9c:1b,bridge_name='br-int',has_traffic_filtering=True,id=94340c9c-a9e1-4658-93a8-c5307e1ab718,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94340c9c-a9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG os_vif [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:9c:1b,bridge_name='br-int',has_traffic_filtering=True,id=94340c9c-a9e1-4658-93a8-c5307e1ab718,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94340c9c-a9') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04b8ccc0-b8a1-5d99-be0f-3c05be1f1b27', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94340c9c-a9, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94340c9c-a9, col_values=(('qos', UUID('ce6dc706-87fd-46ef-9a92-2f7e03f3bea5')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94340c9c-a9, col_values=(('external_ids', {'iface-id': '94340c9c-a9e1-4658-93a8-c5307e1ab718', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:9c:1b', 'vm-uuid': '5ca70dc3-84a3-4ba4-afe0-fde66b512357'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:35 user nova-compute[75288]: INFO os_vif [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:9c:1b,bridge_name='br-int',has_traffic_filtering=True,id=94340c9c-a9e1-4658-93a8-c5307e1ab718,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94340c9c-a9')
Nov 10 22:58:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23731363466316564', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731363466316564', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'flavor' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] No VIF found with MAC fa:16:3e:f2:9c:1b, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 22:58:35 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:58:35 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:58:35 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:58:35 user nova-compute[75288]:   <serial>d1e8dbfa-2e00-4c96-b49d-2acc8b033854</serial>
Nov 10 22:58:35 user nova-compute[75288]: </disk>
Nov 10 22:58:35 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Updated VIF entry in instance network info cache for port 94340c9c-a9e1-4658-93a8-c5307e1ab718. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Updating instance_info_cache with network_info: [{"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-201ce08c-2760-4627-9a6c-9577aefbe555 req-6637d779-89be-448c-88bb-e31157a31449 service nova] Releasing lock "refresh_cache-5ca70dc3-84a3-4ba4-afe0-fde66b512357" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] No VIF found with MAC fa:16:3e:4d:4e:a0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d4ccc191-5684-47a7-ad74-5152bc36867e tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.730s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:58:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'flavor' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-d74827fa-ed32-4cf4-ae2c-60d6e051aa9d req-d0e530a4-c28f-4b09-99ac-a58b4100c12b service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received event network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d74827fa-ed32-4cf4-ae2c-60d6e051aa9d req-d0e530a4-c28f-4b09-99ac-a58b4100c12b service nova] Acquiring lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d74827fa-ed32-4cf4-ae2c-60d6e051aa9d req-d0e530a4-c28f-4b09-99ac-a58b4100c12b service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d74827fa-ed32-4cf4-ae2c-60d6e051aa9d req-d0e530a4-c28f-4b09-99ac-a58b4100c12b service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-d74827fa-ed32-4cf4-ae2c-60d6e051aa9d req-d0e530a4-c28f-4b09-99ac-a58b4100c12b service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] No waiting events found dispatching network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:39 user nova-compute[75288]: WARNING nova.compute.manager [req-d74827fa-ed32-4cf4-ae2c-60d6e051aa9d req-d0e530a4-c28f-4b09-99ac-a58b4100c12b service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received unexpected event network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 for instance with vm_state building and task_state spawning.
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b52275d-57fa-420d-9cf3-3bc21f01d5e6 req-7671a3f9-0316-4746-94c3-516ed31c701c service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received event network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b52275d-57fa-420d-9cf3-3bc21f01d5e6 req-7671a3f9-0316-4746-94c3-516ed31c701c service nova] Acquiring lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b52275d-57fa-420d-9cf3-3bc21f01d5e6 req-7671a3f9-0316-4746-94c3-516ed31c701c service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b52275d-57fa-420d-9cf3-3bc21f01d5e6 req-7671a3f9-0316-4746-94c3-516ed31c701c service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b52275d-57fa-420d-9cf3-3bc21f01d5e6 req-7671a3f9-0316-4746-94c3-516ed31c701c service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] No waiting events found dispatching network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:39 user nova-compute[75288]: WARNING nova.compute.manager [req-0b52275d-57fa-420d-9cf3-3bc21f01d5e6 req-7671a3f9-0316-4746-94c3-516ed31c701c service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received unexpected event network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 for instance with vm_state building and task_state spawning.
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Instance spawned successfully.
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:58:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:58:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8220MB free_disk=24.935035705566406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:39 user nova-compute[75288]: INFO nova.compute.manager [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Detaching volume d1e8dbfa-2e00-4c96-b49d-2acc8b033854
Nov 10 22:58:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a1fbf5b4-51a5-4098-851c-08ab3ed1a916 tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.544s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:39 user nova-compute[75288]: INFO nova.virt.block_device [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Attempting to driver detach volume d1e8dbfa-2e00-4c96-b49d-2acc8b033854 from mountpoint /dev/vdc
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Attempting to detach device vdc from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:58:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:58:39 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:58:39 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:58:39 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:58:39 user nova-compute[75288]:   <serial>d1e8dbfa-2e00-4c96-b49d-2acc8b033854</serial>
Nov 10 22:58:39 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 22:58:39 user nova-compute[75288]: </disk>
Nov 10 22:58:39 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:58:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Successfully detached device vdc from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the persistent domain config.
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:58:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:58:40 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 22:58:40 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Nov 10 22:58:40 user nova-compute[75288]:   <serial>d1e8dbfa-2e00-4c96-b49d-2acc8b033854</serial>
Nov 10 22:58:40 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 22:58:40 user nova-compute[75288]: </disk>
Nov 10 22:58:40 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 04509269-e685-4bdb-8663-6c4a27fb8169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 60307487-1cfc-412f-86c8-994b8d9b47db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 23bd4722-1079-4562-998d-c2e7a77ae541 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 41f056ca-4cf8-423a-8a10-626d6091d835 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5ca70dc3-84a3-4ba4-afe0-fde66b512357 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:58:40 user nova-compute[75288]: INFO nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:58:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Creating image(s)
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Ensure instance console log exists: /opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Start _get_guest_xml network_info=[{"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23bd4722-1079-4562-998d-c2e7a77ae541', 'attached_at': '', 'detached_at': '', 'volume_id': '0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'serial': '0443cd30-ec8e-49c5-839d-f9b78fdc925c'}, 'mount_device': '/dev/vda', 'attachment_id': 'db0b322c-4d00-4a6c-b2be-5dbb07337c20', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:58:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 22:58:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23bd4722-1079-4562-998d-c2e7a77ae541 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:58:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:58:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:58:40 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 22:58:40 user nova-compute[75288]: INFO nova.compute.manager [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Took 7.76 seconds to build instance.
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a7c1a-e36f-4ff0-8199-13e05d0a2290]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 22:58:40 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[910612e1-05f7-4767-be9c-180f75309f6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-104fe5f0-39e0-4de4-ada0-4ef256534078 tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.913s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c] added
Nov 10 22:58:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[408cf232-ace0-43cf-8c81-726001ce0234]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84ffc1-cbdd-4a4c-a983-c579700261c8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzLKkwFu {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzLKkwFu" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da400e60-24dc-48e5-a304-8902a3670ad3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzLKkwFu'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da53afb-baf6-40d4-9be6-9f8cfd6390cb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2e2c78-6423-4489-9400-daa6ff6a17a3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:40 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:40 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:58:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:40 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:40 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:58:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --login" returned: 0 in 1.087s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[74454420-6c81-45ad-b1f3-4bec9ce8ae97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]
Nov 10 22:58:41 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.
Nov 10 22:58:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6043370-6e40-4b57-9aa8-185bc6157d9b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d903e5-6aa1-49a7-93d7-a2e731f024ed]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:41 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:41 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:58:41 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:58:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:58:41 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:58:41 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:58:41 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:58:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.333s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f137a38a-654a-4032-9671-d5290dd0bb25]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.376s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] <== connect_volume: return (2377ms) {'type': 'block', 'scsi_wwn': '23632643334636230', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632643334636230', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227398108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-12392903',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNEBN/sKvUakRElAQv0LqXfXSYlW+aA3xT1hBfSonnb3/AZ9eM3Jf9yQELxqwXxXoj+e+rqEkB5ZpjNNyqya4Bwh6avQ/qjhM186GUIEvmpsGmXT8Vb8aU1BtfwJpGw4Q==',key_name='tempest-keypair-1319776968',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73708f6fd47643998393f71f7b66c828',ramdisk_id='',reservation_id='r-hnbsraog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-326920164',owner_user_name='tempest-ServerActionsV293TestJSON-326920164-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:58:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73df74584ffb411cb7d360b1a28c04cc',uuid=23bd4722-1079-4562-998d-c2e7a77ae541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converting VIF {"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:58:42 user nova-compute[75288]:   <uuid>23bd4722-1079-4562-998d-c2e7a77ae541</uuid>
Nov 10 22:58:42 user nova-compute[75288]:   <name>instance-00000022</name>
Nov 10 22:58:42 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:58:42 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:58:42 user nova-compute[75288]:   <metadata>
Nov 10 22:58:42 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:58:42 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:58:42 user nova-compute[75288]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1227398108</nova:name>
Nov 10 22:58:42 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:58:40</nova:creationTime>
Nov 10 22:58:42 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:58:42 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:58:42 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:58:42 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:58:42 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:58:42 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:58:42 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:58:42 user nova-compute[75288]:       <nova:owner>
Nov 10 22:58:42 user nova-compute[75288]:         <nova:user uuid="73df74584ffb411cb7d360b1a28c04cc">tempest-ServerActionsV293TestJSON-326920164-project-member</nova:user>
Nov 10 22:58:42 user nova-compute[75288]:         <nova:project uuid="73708f6fd47643998393f71f7b66c828">tempest-ServerActionsV293TestJSON-326920164</nova:project>
Nov 10 22:58:42 user nova-compute[75288]:       </nova:owner>
Nov 10 22:58:42 user nova-compute[75288]:       <nova:ports>
Nov 10 22:58:42 user nova-compute[75288]:         <nova:port uuid="2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b">
Nov 10 22:58:42 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 22:58:42 user nova-compute[75288]:         </nova:port>
Nov 10 22:58:42 user nova-compute[75288]:       </nova:ports>
Nov 10 22:58:42 user nova-compute[75288]:     </nova:instance>
Nov 10 22:58:42 user nova-compute[75288]:   </metadata>
Nov 10 22:58:42 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:58:42 user nova-compute[75288]:     <system>
Nov 10 22:58:42 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:58:42 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:58:42 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:58:42 user nova-compute[75288]:       <entry name="serial">23bd4722-1079-4562-998d-c2e7a77ae541</entry>
Nov 10 22:58:42 user nova-compute[75288]:       <entry name="uuid">23bd4722-1079-4562-998d-c2e7a77ae541</entry>
Nov 10 22:58:42 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:58:42 user nova-compute[75288]:     </system>
Nov 10 22:58:42 user nova-compute[75288]:   </sysinfo>
Nov 10 22:58:42 user nova-compute[75288]:   <os>
Nov 10 22:58:42 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:58:42 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:58:42 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:58:42 user nova-compute[75288]:   </os>
Nov 10 22:58:42 user nova-compute[75288]:   <features>
Nov 10 22:58:42 user nova-compute[75288]:     <acpi/>
Nov 10 22:58:42 user nova-compute[75288]:     <apic/>
Nov 10 22:58:42 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:58:42 user nova-compute[75288]:   </features>
Nov 10 22:58:42 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:58:42 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:58:42 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:58:42 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:58:42 user nova-compute[75288]:   </clock>
Nov 10 22:58:42 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:58:42 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:58:42 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:58:42 user nova-compute[75288]:   </cpu>
Nov 10 22:58:42 user nova-compute[75288]:   <devices>
Nov 10 22:58:42 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 22:58:42 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:58:42 user nova-compute[75288]:       <source dev="/dev/sdd"/>
Nov 10 22:58:42 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:58:42 user nova-compute[75288]:       <serial>0443cd30-ec8e-49c5-839d-f9b78fdc925c</serial>
Nov 10 22:58:42 user nova-compute[75288]:     </disk>
Nov 10 22:58:42 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:58:42 user nova-compute[75288]:       <mac address="fa:16:3e:bf:f9:21"/>
Nov 10 22:58:42 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:58:42 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:58:42 user nova-compute[75288]:       <target dev="tap2ca1fd66-ef"/>
Nov 10 22:58:42 user nova-compute[75288]:     </interface>
Nov 10 22:58:42 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:58:42 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541/console.log" append="off"/>
Nov 10 22:58:42 user nova-compute[75288]:     </serial>
Nov 10 22:58:42 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:58:42 user nova-compute[75288]:     <video>
Nov 10 22:58:42 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:58:42 user nova-compute[75288]:     </video>
Nov 10 22:58:42 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:58:42 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:58:42 user nova-compute[75288]:     </rng>
Nov 10 22:58:42 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:58:42 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:58:42 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:58:42 user nova-compute[75288]:     </memballoon>
Nov 10 22:58:42 user nova-compute[75288]:   </devices>
Nov 10 22:58:42 user nova-compute[75288]: </domain>
Nov 10 22:58:42 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227398108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-12392903',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNEBN/sKvUakRElAQv0LqXfXSYlW+aA3xT1hBfSonnb3/AZ9eM3Jf9yQELxqwXxXoj+e+rqEkB5ZpjNNyqya4Bwh6avQ/qjhM186GUIEvmpsGmXT8Vb8aU1BtfwJpGw4Q==',key_name='tempest-keypair-1319776968',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73708f6fd47643998393f71f7b66c828',ramdisk_id='',reservation_id='r-hnbsraog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-326920164',owner_user_name='tempest-ServerActionsV293TestJSON-326920164-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:58:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73df74584ffb411cb7d360b1a28c04cc',uuid=23bd4722-1079-4562-998d-c2e7a77ae541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converting VIF {"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG os_vif [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c092c3dc-13af-5ddf-852a-a0b8442347d6', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ca1fd66-ef, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ca1fd66-ef, col_values=(('qos', UUID('214f8d1e-f18d-458f-8c15-2597d46e94f0')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ca1fd66-ef, col_values=(('external_ids', {'iface-id': '2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:f9:21', 'vm-uuid': '23bd4722-1079-4562-998d-c2e7a77ae541'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:42 user nova-compute[75288]: INFO os_vif [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef')
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] No VIF found with MAC fa:16:3e:bf:f9:21, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:58:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 22:58:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 22:58:43 user nova-compute[75288]: INFO nova.compute.claims [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Claim successful on node user
Nov 10 22:58:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.network.neutron [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-68bb6701-3d93-400b-8f42-864e5a754b14 req-ced039d2-974f-4b14-8db5-60d5324e420b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-68bb6701-3d93-400b-8f42-864e5a754b14 req-ced039d2-974f-4b14-8db5-60d5324e420b service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-68bb6701-3d93-400b-8f42-864e5a754b14 req-ced039d2-974f-4b14-8db5-60d5324e420b service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-68bb6701-3d93-400b-8f42-864e5a754b14 req-ced039d2-974f-4b14-8db5-60d5324e420b service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-68bb6701-3d93-400b-8f42-864e5a754b14 req-ced039d2-974f-4b14-8db5-60d5324e420b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:44 user nova-compute[75288]: WARNING nova.compute.manager [req-68bb6701-3d93-400b-8f42-864e5a754b14 req-ced039d2-974f-4b14-8db5-60d5324e420b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received unexpected event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with vm_state active and task_state rebuild_spawning.
Nov 10 22:58:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.policy [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa64d78d0ed47e9af81121ea1e9e34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8bee5841243ecbc00a012f27016fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 22:58:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Creating image(s)
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.266s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk 1073741824" returned: 0 in 0.066s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Successfully created port: 57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Cannot resize image /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Ensure instance console log exists: /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Successfully updated port: 57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing instance network info cache due to event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:58:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance spawned successfully.
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance network_info: |[{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.neutron [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Start _get_guest_xml network_info=[{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 22:58:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:58:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:58:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-215007874',display_name='tempest-ServerRescueNegativeTestJSON-server-215007874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-215007874',id=38,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDSC9a4Smj3mI6m3JcoREpzwGvJIoyNYgQEOB8JKXAk2RjbBuKOKfCSWhULK01Om31hJKxMNHTnkH/sIKWuNAqhmwp/MhQ6ymktOB+Raer772w07tJPebhMOl3XVlxt6Q==',key_name='tempest-keypair-1928965267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-xx1qth9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=f1959b81-d8a2-451f-bd21-7dafe2ba297a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'pci_devices' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-d669ce66-670c-4405-b542-99663d15af74 req-63ee64b3-786e-4131-a81b-bfe5672269da service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d669ce66-670c-4405-b542-99663d15af74 req-63ee64b3-786e-4131-a81b-bfe5672269da service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d669ce66-670c-4405-b542-99663d15af74 req-63ee64b3-786e-4131-a81b-bfe5672269da service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d669ce66-670c-4405-b542-99663d15af74 req-63ee64b3-786e-4131-a81b-bfe5672269da service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-d669ce66-670c-4405-b542-99663d15af74 req-63ee64b3-786e-4131-a81b-bfe5672269da service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:46 user nova-compute[75288]: WARNING nova.compute.manager [req-d669ce66-670c-4405-b542-99663d15af74 req-63ee64b3-786e-4131-a81b-bfe5672269da service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received unexpected event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with vm_state active and task_state rebuild_spawning.
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 22:58:46 user nova-compute[75288]:   <uuid>f1959b81-d8a2-451f-bd21-7dafe2ba297a</uuid>
Nov 10 22:58:46 user nova-compute[75288]:   <name>instance-00000026</name>
Nov 10 22:58:46 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 22:58:46 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 22:58:46 user nova-compute[75288]:   <metadata>
Nov 10 22:58:46 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 22:58:46 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 22:58:46 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-215007874</nova:name>
Nov 10 22:58:46 user nova-compute[75288]:       <nova:creationTime>2023-11-10 22:58:46</nova:creationTime>
Nov 10 22:58:46 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 22:58:46 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 22:58:46 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 22:58:46 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 22:58:46 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 22:58:46 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 22:58:46 user nova-compute[75288]:       </nova:flavor>
Nov 10 22:58:46 user nova-compute[75288]:       <nova:owner>
Nov 10 22:58:46 user nova-compute[75288]:         <nova:user uuid="8aa64d78d0ed47e9af81121ea1e9e34a">tempest-ServerRescueNegativeTestJSON-423881024-project-member</nova:user>
Nov 10 22:58:46 user nova-compute[75288]:         <nova:project uuid="0fb8bee5841243ecbc00a012f27016fe">tempest-ServerRescueNegativeTestJSON-423881024</nova:project>
Nov 10 22:58:46 user nova-compute[75288]:       </nova:owner>
Nov 10 22:58:46 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 22:58:46 user nova-compute[75288]:       <nova:ports>
Nov 10 22:58:46 user nova-compute[75288]:         <nova:port uuid="57da2b99-5561-4036-b2d0-c14f906c792c">
Nov 10 22:58:46 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 22:58:46 user nova-compute[75288]:         </nova:port>
Nov 10 22:58:46 user nova-compute[75288]:       </nova:ports>
Nov 10 22:58:46 user nova-compute[75288]:     </nova:instance>
Nov 10 22:58:46 user nova-compute[75288]:   </metadata>
Nov 10 22:58:46 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 22:58:46 user nova-compute[75288]:     <system>
Nov 10 22:58:46 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 22:58:46 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 22:58:46 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 22:58:46 user nova-compute[75288]:       <entry name="serial">f1959b81-d8a2-451f-bd21-7dafe2ba297a</entry>
Nov 10 22:58:46 user nova-compute[75288]:       <entry name="uuid">f1959b81-d8a2-451f-bd21-7dafe2ba297a</entry>
Nov 10 22:58:46 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 22:58:46 user nova-compute[75288]:     </system>
Nov 10 22:58:46 user nova-compute[75288]:   </sysinfo>
Nov 10 22:58:46 user nova-compute[75288]:   <os>
Nov 10 22:58:46 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 22:58:46 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 22:58:46 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 22:58:46 user nova-compute[75288]:   </os>
Nov 10 22:58:46 user nova-compute[75288]:   <features>
Nov 10 22:58:46 user nova-compute[75288]:     <acpi/>
Nov 10 22:58:46 user nova-compute[75288]:     <apic/>
Nov 10 22:58:46 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 22:58:46 user nova-compute[75288]:   </features>
Nov 10 22:58:46 user nova-compute[75288]:   <clock offset="utc">
Nov 10 22:58:46 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 22:58:46 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 22:58:46 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 22:58:46 user nova-compute[75288]:   </clock>
Nov 10 22:58:46 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 22:58:46 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 22:58:46 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 22:58:46 user nova-compute[75288]:   </cpu>
Nov 10 22:58:46 user nova-compute[75288]:   <devices>
Nov 10 22:58:46 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 22:58:46 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 22:58:46 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk"/>
Nov 10 22:58:46 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 22:58:46 user nova-compute[75288]:     </disk>
Nov 10 22:58:46 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 22:58:46 user nova-compute[75288]:       <mac address="fa:16:3e:a0:db:0e"/>
Nov 10 22:58:46 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:58:46 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 22:58:46 user nova-compute[75288]:       <target dev="tap57da2b99-55"/>
Nov 10 22:58:46 user nova-compute[75288]:     </interface>
Nov 10 22:58:46 user nova-compute[75288]:     <serial type="pty">
Nov 10 22:58:46 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/console.log" append="off"/>
Nov 10 22:58:46 user nova-compute[75288]:     </serial>
Nov 10 22:58:46 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 22:58:46 user nova-compute[75288]:     <video>
Nov 10 22:58:46 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 22:58:46 user nova-compute[75288]:     </video>
Nov 10 22:58:46 user nova-compute[75288]:     <rng model="virtio">
Nov 10 22:58:46 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 22:58:46 user nova-compute[75288]:     </rng>
Nov 10 22:58:46 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 22:58:46 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 22:58:46 user nova-compute[75288]:       <stats period="10"/>
Nov 10 22:58:46 user nova-compute[75288]:     </memballoon>
Nov 10 22:58:46 user nova-compute[75288]:   </devices>
Nov 10 22:58:46 user nova-compute[75288]: </domain>
Nov 10 22:58:46 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:58:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-215007874',display_name='tempest-ServerRescueNegativeTestJSON-server-215007874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-215007874',id=38,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDSC9a4Smj3mI6m3JcoREpzwGvJIoyNYgQEOB8JKXAk2RjbBuKOKfCSWhULK01Om31hJKxMNHTnkH/sIKWuNAqhmwp/MhQ6ymktOB+Raer772w07tJPebhMOl3XVlxt6Q==',key_name='tempest-keypair-1928965267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-xx1qth9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=f1959b81-d8a2-451f-bd21-7dafe2ba297a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG os_vif [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75288) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38471bd4-d0c2-5f2c-b0dd-b1c1c9908024', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57da2b99-55, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57da2b99-55, col_values=(('qos', UUID('dd318f6c-40e5-4eab-82d6-6d0ddee236be')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57da2b99-55, col_values=(('external_ids', {'iface-id': '57da2b99-5561-4036-b2d0-c14f906c792c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:db:0e', 'vm-uuid': 'f1959b81-d8a2-451f-bd21-7dafe2ba297a'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:46 user nova-compute[75288]: INFO os_vif [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55')
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6bcff09a-71d6-4654-b7fa-472e8a4a5453 tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 22:58:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No VIF found with MAC fa:16:3e:a0:db:0e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 22:58:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updated VIF entry in instance network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:58:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:58:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9178a11a-10eb-4a36-838c-6a255303e63e req-35ffe1f1-7eae-40d7-83ef-97951e134d57 service nova] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc556624-5882-477f-aa60-5331d3b117e6 req-ef0479b9-6170-4c7f-8bc3-0cef3bd7984c service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc556624-5882-477f-aa60-5331d3b117e6 req-ef0479b9-6170-4c7f-8bc3-0cef3bd7984c service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc556624-5882-477f-aa60-5331d3b117e6 req-ef0479b9-6170-4c7f-8bc3-0cef3bd7984c service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc556624-5882-477f-aa60-5331d3b117e6 req-ef0479b9-6170-4c7f-8bc3-0cef3bd7984c service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc556624-5882-477f-aa60-5331d3b117e6 req-ef0479b9-6170-4c7f-8bc3-0cef3bd7984c service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:48 user nova-compute[75288]: WARNING nova.compute.manager [req-fc556624-5882-477f-aa60-5331d3b117e6 req-ef0479b9-6170-4c7f-8bc3-0cef3bd7984c service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state building and task_state spawning.
Nov 10 22:58:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 22:58:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance spawned successfully.
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 22:58:50 user nova-compute[75288]: INFO nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8482cfb-b370-49ae-b259-5105757c7503 req-eb0801a1-7198-4d03-97db-60f42610c4ad service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8482cfb-b370-49ae-b259-5105757c7503 req-eb0801a1-7198-4d03-97db-60f42610c4ad service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8482cfb-b370-49ae-b259-5105757c7503 req-eb0801a1-7198-4d03-97db-60f42610c4ad service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8482cfb-b370-49ae-b259-5105757c7503 req-eb0801a1-7198-4d03-97db-60f42610c4ad service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8482cfb-b370-49ae-b259-5105757c7503 req-eb0801a1-7198-4d03-97db-60f42610c4ad service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:50 user nova-compute[75288]: WARNING nova.compute.manager [req-e8482cfb-b370-49ae-b259-5105757c7503 req-eb0801a1-7198-4d03-97db-60f42610c4ad service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state building and task_state spawning.
Nov 10 22:58:50 user nova-compute[75288]: INFO nova.compute.manager [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Took 7.15 seconds to build instance.
Nov 10 22:58:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-26daa495-a008-4814-a7b7-4800c849d30a tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.262s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:54 user nova-compute[75288]: INFO nova.compute.manager [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Terminating instance
Nov 10 22:58:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-b8bcd8e0-91dc-49f3-b818-74cf2c93611b req-241616e4-6c54-450c-8a6d-ba024d540e5e service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b8bcd8e0-91dc-49f3-b818-74cf2c93611b req-241616e4-6c54-450c-8a6d-ba024d540e5e service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b8bcd8e0-91dc-49f3-b818-74cf2c93611b req-241616e4-6c54-450c-8a6d-ba024d540e5e service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b8bcd8e0-91dc-49f3-b818-74cf2c93611b req-241616e4-6c54-450c-8a6d-ba024d540e5e service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-b8bcd8e0-91dc-49f3-b818-74cf2c93611b req-241616e4-6c54-450c-8a6d-ba024d540e5e service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-b8bcd8e0-91dc-49f3-b818-74cf2c93611b req-241616e4-6c54-450c-8a6d-ba024d540e5e service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-unplugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:58:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Instance destroyed successfully.
Nov 10 22:58:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lazy-loading 'resources' on Instance uuid 04509269-e685-4bdb-8663-6c4a27fb8169 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-970360194',display_name='tempest-ServerStableDeviceRescueTest-server-970360194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-970360194',id=31,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObVP8O6Nr1VHNeR/aDPh9glerFl/Ksu5hCAH/IB2ClN5ICro3vIhpZ6yIeZWAv3x/Z6at08dxbuQqBi0goqSR/VYzNupGo0JUKcvS6bysNUtzCZg+QESV5SyOA+OzoGwQ==',key_name='tempest-keypair-1094930237',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9547e47532da49bcb20296c6485577a2',ramdisk_id='',reservation_id='r-x5apaqpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-239004557',owner_user_name='tempest-ServerStableDeviceRescueTest-239004557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9010fc645ad54495bd090cfffad16a0e',uuid=04509269-e685-4bdb-8663-6c4a27fb8169,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converting VIF {"id": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "address": "fa:16:3e:c7:79:ec", "network": {"id": "bdd4e298-8c65-433c-922e-33345e716af4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-796019717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9547e47532da49bcb20296c6485577a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3f6fa3-d1", "ovs_interfaceid": "fc3f6fa3-d1c2-4c8b-a442-15071214b6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG os_vif [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc3f6fa3-d1, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cebf193-1f12-469d-b015-eca4616a8b22) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:58:55 user nova-compute[75288]: INFO os_vif [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:79:ec,bridge_name='br-int',has_traffic_filtering=True,id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8,network=Network(bdd4e298-8c65-433c-922e-33345e716af4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3f6fa3-d1')
Nov 10 22:58:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Deleting instance files /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169_del
Nov 10 22:58:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Deletion of /opt/stack/data/nova/instances/04509269-e685-4bdb-8663-6c4a27fb8169_del complete
Nov 10 22:58:55 user nova-compute[75288]: INFO nova.compute.manager [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 10 22:58:55 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:58:55 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:58:56 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Took 1.12 seconds to deallocate network for instance.
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-a8e325fd-7656-4279-98c3-37184a8154f7 req-2151bf1f-0bcc-4cb3-a271-23c58bde87b7 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-deleted-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:56 user nova-compute[75288]: INFO nova.compute.manager [req-a8e325fd-7656-4279-98c3-37184a8154f7 req-2151bf1f-0bcc-4cb3-a271-23c58bde87b7 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Neutron deleted interface fc3f6fa3-d1c2-4c8b-a442-15071214b6c8; detaching it from the instance and deleting it from the info cache
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-a8e325fd-7656-4279-98c3-37184a8154f7 req-2151bf1f-0bcc-4cb3-a271-23c58bde87b7 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-a8e325fd-7656-4279-98c3-37184a8154f7 req-2151bf1f-0bcc-4cb3-a271-23c58bde87b7 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Detach interface failed, port_id=fc3f6fa3-d1c2-4c8b-a442-15071214b6c8, reason: Instance 04509269-e685-4bdb-8663-6c4a27fb8169 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-db2092f2-9c77-4b3c-83a8-e270d33f2548 req-61b65fce-a7d0-4c01-998c-abd198221482 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db2092f2-9c77-4b3c-83a8-e270d33f2548 req-61b65fce-a7d0-4c01-998c-abd198221482 service nova] Acquiring lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db2092f2-9c77-4b3c-83a8-e270d33f2548 req-61b65fce-a7d0-4c01-998c-abd198221482 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-db2092f2-9c77-4b3c-83a8-e270d33f2548 req-61b65fce-a7d0-4c01-998c-abd198221482 service nova] Lock "04509269-e685-4bdb-8663-6c4a27fb8169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-db2092f2-9c77-4b3c-83a8-e270d33f2548 req-61b65fce-a7d0-4c01-998c-abd198221482 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] No waiting events found dispatching network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:58:56 user nova-compute[75288]: WARNING nova.compute.manager [req-db2092f2-9c77-4b3c-83a8-e270d33f2548 req-61b65fce-a7d0-4c01-998c-abd198221482 service nova] [instance: 04509269-e685-4bdb-8663-6c4a27fb8169] Received unexpected event network-vif-plugged-fc3f6fa3-d1c2-4c8b-a442-15071214b6c8 for instance with vm_state deleted and task_state None.
Nov 10 22:58:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:56 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Deleted allocations for instance 04509269-e685-4bdb-8663-6c4a27fb8169
Nov 10 22:58:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-462990f2-c228-46e3-8e50-dd67feb7828e tempest-ServerStableDeviceRescueTest-239004557 tempest-ServerStableDeviceRescueTest-239004557-project-member] Lock "04509269-e685-4bdb-8663-6c4a27fb8169" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.707s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:58:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 41f056ca-4cf8-423a-8a10-626d6091d835 is timed out.
Nov 10 22:59:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Successfully detached device vdc from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the live domain config.
Nov 10 22:59:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wleAxFPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:59:00 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c617702f-8f8a-465c-a59f-4110371ad578]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:59:00 user nova-compute[75288]: No targets found.
Nov 10 22:59:00 user nova-compute[75288]: iSNS:
Nov 10 22:59:00 user nova-compute[75288]: No targets found.
Nov 10 22:59:00 user nova-compute[75288]: STATIC:
Nov 10 22:59:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5
Nov 10 22:59:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:00 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854
Nov 10 22:59:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:00 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e
Nov 10 22:59:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:00 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c
Nov 10 22:59:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:00 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:00 user nova-compute[75288]: FIRMWARE:
Nov 10 22:59:00 user nova-compute[75288]: No targets found.
Nov 10 22:59:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:59:00 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:59:00 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34851446-df03-4c70-b79b-e678120a59d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532b7a1-f571-494b-b81d-12b2cec8c1a9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:59:00 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:59:00 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:59:00 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:59:00 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:59:00 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 (non-flash)
Nov 10 22:59:00 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b101a4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28480b0-881f-403b-bde9-7c40bcded635]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c2f3c2-3f14-4f56-95bc-f6ed2d499e31]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eceba77-f903-448f-a6ee-a65352c9970a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e4986-19dc-4859-b715-9f4df817a9eb]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9127f0d-f93f-4862-866f-d4e1745587b8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaad0ed-d358-408b-b479-1840b792d35b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260]
Nov 10 22:59:00 user nova-compute[75288]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854, portal: 172.16.0.220,3260] successful.
Nov 10 22:59:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e8dbfa-2e00-4c96-b49d-2acc8b033854 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7218a0-adbd-4885-ac20-bc2581f07eeb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] <== disconnect_volume: return (322ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:59:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:59:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'flavor' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:59:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4d939b19-ee80-4674-94d3-de1c888fc3e5 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.087s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:59:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing instance network info cache due to event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] Acquiring lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] Acquired lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updated VIF entry in instance network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbba25f4-1e62-4c7c-86bf-db24c4dd2e39 req-080db56a-2e20-4477-a6bb-b8fb0ca04951 service nova] Releasing lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:59:17 user nova-compute[75288]: INFO nova.compute.manager [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Detaching volume e3feb2c9-716f-41dd-96d1-8c2c7e498f4e
Nov 10 22:59:17 user nova-compute[75288]: INFO nova.virt.block_device [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Attempting to driver detach volume e3feb2c9-716f-41dd-96d1-8c2c7e498f4e from mountpoint /dev/vdb
Nov 10 22:59:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Attempting to detach device vdb from instance 60307487-1cfc-412f-86c8-994b8d9b47db from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:59:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:59:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:59:18 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:59:18 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:59:18 user nova-compute[75288]:   <serial>e3feb2c9-716f-41dd-96d1-8c2c7e498f4e</serial>
Nov 10 22:59:18 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:59:18 user nova-compute[75288]: </disk>
Nov 10 22:59:18 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:59:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully detached device vdb from instance 60307487-1cfc-412f-86c8-994b8d9b47db from the persistent domain config.
Nov 10 22:59:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60307487-1cfc-412f-86c8-994b8d9b47db from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:59:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:59:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:59:18 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 22:59:18 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:59:18 user nova-compute[75288]:   <serial>e3feb2c9-716f-41dd-96d1-8c2c7e498f4e</serial>
Nov 10 22:59:18 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 22:59:18 user nova-compute[75288]: </disk>
Nov 10 22:59:18 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:59:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing instance network info cache due to event network-changed-8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] Acquiring lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] Acquired lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Refreshing network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updated VIF entry in instance network info cache for port 8608898a-9485-46c2-9f58-d8aaf19f2ad3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [{"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:59:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bad1fd11-3036-49b4-bb60-2f1bca3872bd req-7f492900-fa4e-4a6d-a910-7df09a2a1435 service nova] Releasing lock "refresh_cache-60307487-1cfc-412f-86c8-994b8d9b47db" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:59:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:59:28 user nova-compute[75288]: INFO nova.compute.manager [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Detaching volume 3e8cd4a7-e9ab-48b3-a163-184bd309a8a5
Nov 10 22:59:28 user nova-compute[75288]: INFO nova.virt.block_device [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Attempting to driver detach volume 3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 from mountpoint /dev/vdb
Nov 10 22:59:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Attempting to detach device vdb from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 22:59:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:59:28 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:59:28 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:59:28 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:59:28 user nova-compute[75288]:   <serial>3e8cd4a7-e9ab-48b3-a163-184bd309a8a5</serial>
Nov 10 22:59:28 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:59:28 user nova-compute[75288]: </disk>
Nov 10 22:59:28 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:59:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Successfully detached device vdb from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the persistent domain config.
Nov 10 22:59:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 22:59:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 22:59:28 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 22:59:28 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 22:59:28 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 22:59:28 user nova-compute[75288]:   <serial>3e8cd4a7-e9ab-48b3-a163-184bd309a8a5</serial>
Nov 10 22:59:28 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 22:59:28 user nova-compute[75288]: </disk>
Nov 10 22:59:28 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 22:59:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 22:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:59:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:59:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:59:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:59:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:59:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:59:37 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=7995MB free_disk=24.992206573486328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 60307487-1cfc-412f-86c8-994b8d9b47db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 23bd4722-1079-4562-998d-c2e7a77ae541 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 41f056ca-4cf8-423a-8a10-626d6091d835 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5ca70dc3-84a3-4ba4-afe0-fde66b512357 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f1959b81-d8a2-451f-bd21-7dafe2ba297a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:59:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60307487-1cfc-412f-86c8-994b8d9b47db is timed out.
Nov 10 22:59:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully detached device vdb from instance 60307487-1cfc-412f-86c8-994b8d9b47db from the live domain config.
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbwtjELC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:59:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a2337-9237-4dd6-9d24-1768efc352d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:59:38 user nova-compute[75288]: No targets found.
Nov 10 22:59:38 user nova-compute[75288]: iSNS:
Nov 10 22:59:38 user nova-compute[75288]: No targets found.
Nov 10 22:59:38 user nova-compute[75288]: STATIC:
Nov 10 22:59:38 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5
Nov 10 22:59:38 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:38 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:38 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e
Nov 10 22:59:38 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:38 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:38 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c
Nov 10 22:59:38 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:38 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:38 user nova-compute[75288]: FIRMWARE:
Nov 10 22:59:38 user nova-compute[75288]: No targets found.
Nov 10 22:59:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:59:38 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:59:38 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8f257-706e-4cf3-b5e4-107b9d982ee1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[199608a4-4793-4c02-88f2-eb203e457ff6]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:59:38 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:59:38 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e (non-flash)
Nov 10 22:59:38 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:59:38 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b102d2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7017335-58c1-4f64-97cc-9858650a5a6f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b29a6-55ec-4184-a7cf-5926b827d889]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541e572-627f-4c47-9a3f-fd0199fd1ec1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c23a7b-0f8e-47da-bf18-6cdff1156efe]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04012e4-0605-4122-8b50-43184b893fc2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd7f9f-c51a-4508-b372-3efe495804a7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260]
Nov 10 22:59:38 user nova-compute[75288]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e, portal: 172.16.0.220,3260] successful.
Nov 10 22:59:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3feb2c9-716f-41dd-96d1-8c2c7e498f4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c4a5f-1808-4fe8-8d88-23f2106909c0]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== disconnect_volume: return (290ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:59:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updating instance_info_cache with network_info: [{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 22:59:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'flavor' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:59:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea363322-60c5-4cbd-a0d7-6885fe1cb24b tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.151s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:59:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:59:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 41f056ca-4cf8-423a-8a10-626d6091d835 is timed out.
Nov 10 22:59:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Successfully detached device vdb from instance 41f056ca-4cf8-423a-8a10-626d6091d835 from the live domain config.
Nov 10 22:59:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQPKwGhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:59:48 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e257907e-7360-4ed2-add5-c8ce644bd58d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:59:48 user nova-compute[75288]: No targets found.
Nov 10 22:59:48 user nova-compute[75288]: iSNS:
Nov 10 22:59:48 user nova-compute[75288]: No targets found.
Nov 10 22:59:48 user nova-compute[75288]: STATIC:
Nov 10 22:59:48 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5
Nov 10 22:59:48 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:48 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:48 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c
Nov 10 22:59:48 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:48 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:48 user nova-compute[75288]: FIRMWARE:
Nov 10 22:59:48 user nova-compute[75288]: No targets found.
Nov 10 22:59:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:59:48 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:59:48 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82ac55-617d-413e-b090-c9ffadb47958]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a70ca-cd43-455c-994a-b52042b42f84]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:59:48 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 (non-flash)
Nov 10 22:59:48 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b101c1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[495fab78-a1e9-464f-b61e-10b9c2508f7a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e1ed7-f344-4628-906d-2fe7efc1df46]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2e2a1-16b3-4074-bf6d-f3d0c1fbddf3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54556538-0d5e-4397-ac81-eff834af6248]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100acd9-89aa-43fd-8a53-0a923315719b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33c674-efc8-4c7e-8c0e-9a90b4a0125c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260]
Nov 10 22:59:49 user nova-compute[75288]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5, portal: 172.16.0.220,3260] successful.
Nov 10 22:59:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e8cd4a7-e9ab-48b3-a163-184bd309a8a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04309068-f452-474c-8b17-01a27ca51425]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] <== disconnect_volume: return (317ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:59:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:59:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'flavor' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:59:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0640488b-c118-4986-a1ae-222d9513e5e4 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.021s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:59:50 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:59:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:59:58 user nova-compute[75288]: INFO nova.compute.manager [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Terminating instance
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-d3302feb-06f5-4de7-bb5f-97c5b06a5527 req-7b7b1b14-bb5d-4749-915f-7e27788680a9 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-unplugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d3302feb-06f5-4de7-bb5f-97c5b06a5527 req-7b7b1b14-bb5d-4749-915f-7e27788680a9 service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d3302feb-06f5-4de7-bb5f-97c5b06a5527 req-7b7b1b14-bb5d-4749-915f-7e27788680a9 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d3302feb-06f5-4de7-bb5f-97c5b06a5527 req-7b7b1b14-bb5d-4749-915f-7e27788680a9 service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-d3302feb-06f5-4de7-bb5f-97c5b06a5527 req-7b7b1b14-bb5d-4749-915f-7e27788680a9 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-unplugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-d3302feb-06f5-4de7-bb5f-97c5b06a5527 req-7b7b1b14-bb5d-4749-915f-7e27788680a9 service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-unplugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 22:59:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Instance destroyed successfully.
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lazy-loading 'resources' on Instance uuid 23bd4722-1079-4562-998d-c2e7a77ae541 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227398108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-12392903',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNEBN/sKvUakRElAQv0LqXfXSYlW+aA3xT1hBfSonnb3/AZ9eM3Jf9yQELxqwXxXoj+e+rqEkB5ZpjNNyqya4Bwh6avQ/qjhM186GUIEvmpsGmXT8Vb8aU1BtfwJpGw4Q==',key_name='tempest-keypair-1319776968',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73708f6fd47643998393f71f7b66c828',ramdisk_id='',reservation_id='r-hnbsraog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-326920164',owner_user_name='tempest-ServerActionsV293TestJSON-326920164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73df74584ffb411cb7d360b1a28c04cc',uuid=23bd4722-1079-4562-998d-c2e7a77ae541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converting VIF {"id": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "address": "fa:16:3e:bf:f9:21", "network": {"id": "4500c61d-2521-4fde-8fa4-da3fec19bdec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1023770105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73708f6fd47643998393f71f7b66c828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca1fd66-ef", "ovs_interfaceid": "2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_vif [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ca1fd66-ef, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=214f8d1e-f18d-458f-8c15-2597d46e94f0) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:59:58 user nova-compute[75288]: INFO os_vif [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:f9:21,bridge_name='br-int',has_traffic_filtering=True,id=2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b,network=Network(4500c61d-2521-4fde-8fa4-da3fec19bdec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca1fd66-ef')
Nov 10 22:59:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzLKkwFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 22:59:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa0bb7-24ff-4ed4-a300-974cfd0638da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 22:59:58 user nova-compute[75288]: No targets found.
Nov 10 22:59:58 user nova-compute[75288]: iSNS:
Nov 10 22:59:58 user nova-compute[75288]: No targets found.
Nov 10 22:59:58 user nova-compute[75288]: STATIC:
Nov 10 22:59:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c
Nov 10 22:59:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 22:59:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 22:59:58 user nova-compute[75288]: FIRMWARE:
Nov 10 22:59:58 user nova-compute[75288]: No targets found.
Nov 10 22:59:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 22:59:58 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 22:59:58 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[891360fc-e867-4b3d-a4bc-ef19bea374b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2387d-dcdc-47ce-8d59-c9c8bf9baa4a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c (non-flash)
Nov 10 22:59:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b1033b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7f266-398a-4114-83a7-81e7cd9145da]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f2df61-383e-4b26-8ea8-9ae616cd3bd6]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 22:59:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a358d6a-961b-4515-93d4-6296354076e9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39fde48-9f73-47c5-a2a7-1fa603fb8441]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff864e5-15a6-4d3c-8ec3-1185f678e059]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[259e677a-d454-4419-a87b-6ac67a1ffbb2]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260]
Nov 10 22:59:59 user nova-compute[75288]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c, portal: 172.16.0.220,3260] successful.
Nov 10 22:59:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0443cd30-ec8e-49c5-839d-f9b78fdc925c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34f7b9a-c413-41b5-bf06-893e7601201f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] <== disconnect_volume: return (318ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 22:59:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Deleting instance files /opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541_del
Nov 10 22:59:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Deletion of /opt/stack/data/nova/instances/23bd4722-1079-4562-998d-c2e7a77ae541_del complete
Nov 10 22:59:59 user nova-compute[75288]: INFO nova.compute.manager [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 22:59:59 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 22:59:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:00 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:00:00 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Took 1.25 seconds to deallocate network for instance.
Nov 10 23:00:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-00bcc713-2cdd-4950-95df-fc6b8754f9e8 req-3780bd6a-7fed-4cca-90bd-4dbe2099df5b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-deleted-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-6189003f-7fc7-4774-94c3-7e1fe11778da req-b83cb9d0-91d8-4ba6-ba40-116631a6494b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6189003f-7fc7-4774-94c3-7e1fe11778da req-b83cb9d0-91d8-4ba6-ba40-116631a6494b service nova] Acquiring lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6189003f-7fc7-4774-94c3-7e1fe11778da req-b83cb9d0-91d8-4ba6-ba40-116631a6494b service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6189003f-7fc7-4774-94c3-7e1fe11778da req-b83cb9d0-91d8-4ba6-ba40-116631a6494b service nova] Lock "23bd4722-1079-4562-998d-c2e7a77ae541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-6189003f-7fc7-4774-94c3-7e1fe11778da req-b83cb9d0-91d8-4ba6-ba40-116631a6494b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] No waiting events found dispatching network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:00:00 user nova-compute[75288]: WARNING nova.compute.manager [req-6189003f-7fc7-4774-94c3-7e1fe11778da req-b83cb9d0-91d8-4ba6-ba40-116631a6494b service nova] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Received unexpected event network-vif-plugged-2ca1fd66-efb5-4714-ba1c-d6a2e9a27c4b for instance with vm_state active and task_state deleting.
Nov 10 23:00:01 user nova-compute[75288]: INFO nova.compute.manager [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Took 1.10 seconds to detach 1 volumes for instance.
Nov 10 23:00:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] [instance: 23bd4722-1079-4562-998d-c2e7a77ae541] Deleting volume: 0443cd30-ec8e-49c5-839d-f9b78fdc925c {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 23:00:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:01 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:00:02 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:00:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:02 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Deleted allocations for instance 23bd4722-1079-4562-998d-c2e7a77ae541
Nov 10 23:00:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a830a6fe-26af-48be-937a-0c18fad8a17e tempest-ServerActionsV293TestJSON-326920164 tempest-ServerActionsV293TestJSON-326920164-project-member] Lock "23bd4722-1079-4562-998d-c2e7a77ae541" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.156s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:18 user nova-compute[75288]: INFO nova.compute.manager [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Terminating instance
Nov 10 23:00:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-9a489f66-516c-4b23-91af-c3e8db539ff2 req-f11154c6-f7ae-479b-ae6f-a958978211cb service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-vif-unplugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9a489f66-516c-4b23-91af-c3e8db539ff2 req-f11154c6-f7ae-479b-ae6f-a958978211cb service nova] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9a489f66-516c-4b23-91af-c3e8db539ff2 req-f11154c6-f7ae-479b-ae6f-a958978211cb service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9a489f66-516c-4b23-91af-c3e8db539ff2 req-f11154c6-f7ae-479b-ae6f-a958978211cb service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-9a489f66-516c-4b23-91af-c3e8db539ff2 req-f11154c6-f7ae-479b-ae6f-a958978211cb service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] No waiting events found dispatching network-vif-unplugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-9a489f66-516c-4b23-91af-c3e8db539ff2 req-f11154c6-f7ae-479b-ae6f-a958978211cb service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-vif-unplugged-00dde69e-52cb-4abc-899b-927901184704 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:00:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Instance destroyed successfully.
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lazy-loading 'resources' on Instance uuid 41f056ca-4cf8-423a-8a10-626d6091d835 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1381810489',display_name='tempest-TestServerVolumeAttachmentScenario-server-1381810489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1381810489',id=35,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZSwNw8d8vwjd0XE9T/Za/PL/LtmiiLFl77HRzuHvB64WhzfUr9s2bBvXvsF3htW7P12pN8G2apSi0UVd4retUWASFCU4tYj5Uw76izBa/mY+02U6rvbiI/5dtJfs6dSw==',key_name='tempest-keypair-1985505397',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='019729fd4a184b7ab31cfd1022f897c5',ramdisk_id='',reservation_id='r-j0ljdwd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1220589635',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1220589635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75dd1a64271449cd93203fe3505e6a6d',uuid=41f056ca-4cf8-423a-8a10-626d6091d835,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Converting VIF {"id": "00dde69e-52cb-4abc-899b-927901184704", "address": "fa:16:3e:4d:4e:a0", "network": {"id": "c281d140-ce23-4a93-a732-8e63c39932ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-877937021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "019729fd4a184b7ab31cfd1022f897c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00dde69e-52", "ovs_interfaceid": "00dde69e-52cb-4abc-899b-927901184704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4e:a0,bridge_name='br-int',has_traffic_filtering=True,id=00dde69e-52cb-4abc-899b-927901184704,network=Network(c281d140-ce23-4a93-a732-8e63c39932ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00dde69e-52') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG os_vif [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4e:a0,bridge_name='br-int',has_traffic_filtering=True,id=00dde69e-52cb-4abc-899b-927901184704,network=Network(c281d140-ce23-4a93-a732-8e63c39932ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00dde69e-52') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00dde69e-52, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d65cdc02-d7af-4cc6-8644-6dc8dcfaadb0) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:19 user nova-compute[75288]: INFO os_vif [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4e:a0,bridge_name='br-int',has_traffic_filtering=True,id=00dde69e-52cb-4abc-899b-927901184704,network=Network(c281d140-ce23-4a93-a732-8e63c39932ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00dde69e-52')
Nov 10 23:00:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Deleting instance files /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835_del
Nov 10 23:00:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Deletion of /opt/stack/data/nova/instances/41f056ca-4cf8-423a-8a10-626d6091d835_del complete
Nov 10 23:00:19 user nova-compute[75288]: INFO nova.compute.manager [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 23:00:19 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:00:19 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:00:20 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:00:20 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Took 1.13 seconds to deallocate network for instance.
Nov 10 23:00:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-d7eb202c-dbf2-4bcf-a1b9-03fbefb14a43 req-08389a5b-64f1-4607-bd34-026a3fd22967 service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-vif-deleted-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:20 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:00:20 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:20 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Deleted allocations for instance 41f056ca-4cf8-423a-8a10-626d6091d835
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2b543ff4-6af6-4ed2-86ae-4d86636eef84 tempest-TestServerVolumeAttachmentScenario-1220589635 tempest-TestServerVolumeAttachmentScenario-1220589635-project-member] Lock "41f056ca-4cf8-423a-8a10-626d6091d835" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:21 user nova-compute[75288]: INFO nova.compute.manager [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Terminating instance
Nov 10 23:00:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-1458c727-67a4-4ef2-af84-8592dc2617e5 req-c9f7b6f8-b158-41b3-a7d7-9a9a54ecbfed service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received event network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1458c727-67a4-4ef2-af84-8592dc2617e5 req-c9f7b6f8-b158-41b3-a7d7-9a9a54ecbfed service nova] Acquiring lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1458c727-67a4-4ef2-af84-8592dc2617e5 req-c9f7b6f8-b158-41b3-a7d7-9a9a54ecbfed service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1458c727-67a4-4ef2-af84-8592dc2617e5 req-c9f7b6f8-b158-41b3-a7d7-9a9a54ecbfed service nova] Lock "41f056ca-4cf8-423a-8a10-626d6091d835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-1458c727-67a4-4ef2-af84-8592dc2617e5 req-c9f7b6f8-b158-41b3-a7d7-9a9a54ecbfed service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] No waiting events found dispatching network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:00:21 user nova-compute[75288]: WARNING nova.compute.manager [req-1458c727-67a4-4ef2-af84-8592dc2617e5 req-c9f7b6f8-b158-41b3-a7d7-9a9a54ecbfed service nova] [instance: 41f056ca-4cf8-423a-8a10-626d6091d835] Received unexpected event network-vif-plugged-00dde69e-52cb-4abc-899b-927901184704 for instance with vm_state deleted and task_state None.
Nov 10 23:00:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Instance destroyed successfully.
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'resources' on Instance uuid 60307487-1cfc-412f-86c8-994b8d9b47db {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-707260519',display_name='tempest-TestMinimumBasicScenario-server-707260519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-707260519',id=33,image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAnycqgamJwND3ivFUe2jrg9RcTBb7FqWtujrWk9V0BByF54ALcpf7Ow0h3nUkotkz/DSyNhh4DzVfVP+E248pNersZ8Xnr3f9sUZnvgnpL84DE4/3hM1icjyay/OSXNQ==',key_name='tempest-TestMinimumBasicScenario-817919814',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-z5nhbbqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e308fd24-621c-4d7b-86e9-9d9c313386b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:57:33Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=60307487-1cfc-412f-86c8-994b8d9b47db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "address": "fa:16:3e:b9:50:33", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8608898a-94", "ovs_interfaceid": "8608898a-9485-46c2-9f58-d8aaf19f2ad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG os_vif [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8608898a-94, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45e04da0-98ef-4f3a-8ec4-c7e251cb98db) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:00:22 user nova-compute[75288]: INFO os_vif [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:50:33,bridge_name='br-int',has_traffic_filtering=True,id=8608898a-9485-46c2-9f58-d8aaf19f2ad3,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8608898a-94')
Nov 10 23:00:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Deleting instance files /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db_del
Nov 10 23:00:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Deletion of /opt/stack/data/nova/instances/60307487-1cfc-412f-86c8-994b8d9b47db_del complete
Nov 10 23:00:22 user nova-compute[75288]: INFO nova.compute.manager [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:00:22 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Took 0.44 seconds to deallocate network for instance.
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-unplugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-unplugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-unplugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] Acquiring lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] Lock "60307487-1cfc-412f-86c8-994b8d9b47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] No waiting events found dispatching network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:00:22 user nova-compute[75288]: WARNING nova.compute.manager [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received unexpected event network-vif-plugged-8608898a-9485-46c2-9f58-d8aaf19f2ad3 for instance with vm_state active and task_state deleting.
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-012472f4-0b3e-4385-ad6d-ec244cdcecc1 req-1ffa5a1e-ed5c-43bb-a4c9-538336daec1f service nova] [instance: 60307487-1cfc-412f-86c8-994b8d9b47db] Received event network-vif-deleted-8608898a-9485-46c2-9f58-d8aaf19f2ad3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:22 user nova-compute[75288]: INFO nova.compute.manager [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Terminating instance
Nov 10 23:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:22 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Deleted allocations for instance 60307487-1cfc-412f-86c8-994b8d9b47db
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-be48cf70-7f99-4238-87b9-037fe33de6a7 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "60307487-1cfc-412f-86c8-994b8d9b47db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Instance destroyed successfully.
Nov 10 23:00:23 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lazy-loading 'resources' on Instance uuid 5ca70dc3-84a3-4ba4-afe0-fde66b512357 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1764689881',display_name='tempest-VolumesActionsTest-instance-1764689881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1764689881',id=37,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622aa0fa0ece481b88f19e55fe547117',ramdisk_id='',reservation_id='r-shnfogsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-92480672',owner_user_name='tempest-VolumesActionsTest-92480672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:58:40Z,user_data=None,user_id='8212f40024264c4d930417929bd14f96',uuid=5ca70dc3-84a3-4ba4-afe0-fde66b512357,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converting VIF {"id": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "address": "fa:16:3e:f2:9c:1b", "network": {"id": "d2163569-3ed7-4a3b-a12a-ed152a23a82c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1620829192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622aa0fa0ece481b88f19e55fe547117", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94340c9c-a9", "ovs_interfaceid": "94340c9c-a9e1-4658-93a8-c5307e1ab718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:9c:1b,bridge_name='br-int',has_traffic_filtering=True,id=94340c9c-a9e1-4658-93a8-c5307e1ab718,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94340c9c-a9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG os_vif [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:9c:1b,bridge_name='br-int',has_traffic_filtering=True,id=94340c9c-a9e1-4658-93a8-c5307e1ab718,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94340c9c-a9') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94340c9c-a9, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce6dc706-87fd-46ef-9a92-2f7e03f3bea5) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:00:23 user nova-compute[75288]: INFO os_vif [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:9c:1b,bridge_name='br-int',has_traffic_filtering=True,id=94340c9c-a9e1-4658-93a8-c5307e1ab718,network=Network(d2163569-3ed7-4a3b-a12a-ed152a23a82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94340c9c-a9')
Nov 10 23:00:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Deleting instance files /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357_del
Nov 10 23:00:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Deletion of /opt/stack/data/nova/instances/5ca70dc3-84a3-4ba4-afe0-fde66b512357_del complete
Nov 10 23:00:23 user nova-compute[75288]: INFO nova.compute.manager [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 23:00:23 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:00:23 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:00:24 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Took 0.42 seconds to deallocate network for instance.
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:24 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Deleted allocations for instance 5ca70dc3-84a3-4ba4-afe0-fde66b512357
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec22e9bb-4eac-49c0-8149-3fe44383dbaa tempest-VolumesActionsTest-92480672 tempest-VolumesActionsTest-92480672-project-member] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.770s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received event network-vif-unplugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] Acquiring lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] No waiting events found dispatching network-vif-unplugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:00:24 user nova-compute[75288]: WARNING nova.compute.manager [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received unexpected event network-vif-unplugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 for instance with vm_state deleted and task_state None.
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received event network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] Acquiring lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] Lock "5ca70dc3-84a3-4ba4-afe0-fde66b512357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] No waiting events found dispatching network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:00:24 user nova-compute[75288]: WARNING nova.compute.manager [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received unexpected event network-vif-plugged-94340c9c-a9e1-4658-93a8-c5307e1ab718 for instance with vm_state deleted and task_state None.
Nov 10 23:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-8aed1ba4-590b-4169-bf47-77b6d432f172 req-fe982b65-3b70-48ea-adc2-b37d5b8d89d6 service nova] [instance: 5ca70dc3-84a3-4ba4-afe0-fde66b512357] Received event network-vif-deleted-94340c9c-a9e1-4658-93a8-c5307e1ab718 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing instance network info cache due to event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'flavor' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:34 user nova-compute[75288]: INFO nova.compute.manager [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Attaching volume 3097c7ce-d7e3-4033-9c00-0c00a69867f3 to /dev/vdb
Nov 10 23:00:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updated VIF entry in instance network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e2d4f3f-d353-4b05-a216-b1cd28da9385 req-a318686b-189e-4015-8903-bcde6179c3f4 service nova] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG os_brick.utils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4646bf-5688-4915-9c89-a4e066e2596e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43aabee-6da5-4de8-a165-a6255d98038d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4d209d-b8de-40c2-9238-7369b7498b63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3828fb-8283-4ea8-9232-42d63244c8a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:00:35 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:00:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[552914e7-e859-4506-94de-312527c164f6]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:00:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:00:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:00:35 user nova-compute[75288]: DEBUG os_brick.utils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:00:35 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating existing volume attachment record: 00368e99-562e-4bbc-a0b8-bb656480ce2f {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:00:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:00:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:00:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8517MB free_disk=25.073535919189453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:00:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f1959b81-d8a2-451f-bd21-7dafe2ba297a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:00:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:00:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 23:00:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:00:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:00:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ecduntjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:00:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:00:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:00:58 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[155f19f6-d725-463f-b310-c78887748103]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:00:58 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaf5fbb-7a98-4a9e-ad25-b78a58981b51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3] added
Nov 10 23:00:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d268939d-18c4-4332-b29c-4ec4f53d9e5b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c438c1e6-5f14-458b-8934-fb7af6690378]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ecduntjg {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ecduntjg" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a16100-eb00-4edd-862e-d1b9a458e1ae]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ecduntjg'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[860097be-1ec1-4faa-9b0e-2caec2009ad2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f7023c-1ba7-4ecc-a978-fa8b1292b95b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:00:59 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:00:59 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:00:59 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 23:00:59 user nova-compute[75288]: 
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1049e7-12ac-4120-a4b7-570fdd412be7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260]
Nov 10 23:00:59 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260] successful.
Nov 10 23:00:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[941adfd8-e98a-4791-9b68-1c04286d0b50]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ccf874-4ffb-494f-908f-83d0c254800d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:00:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:00:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da73718b-5af6-4d8d-a2ab-e1df0d1a7724]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ecduntjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:00:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23464623838613061', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464623838613061', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'flavor' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 23:01:00 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:01:00 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 23:01:00 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:01:00 user nova-compute[75288]:   <serial>3097c7ce-d7e3-4033-9c00-0c00a69867f3</serial>
Nov 10 23:01:00 user nova-compute[75288]: </disk>
Nov 10 23:01:00 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No VIF found with MAC fa:16:3e:a0:db:0e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:01:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2f4da80c-02e5-4b77-8881-91d85c246dd6 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.946s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:01 user nova-compute[75288]: INFO nova.compute.manager [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Rescuing
Nov 10 23:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:01:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:01:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:01:02 user nova-compute[75288]: INFO nova.compute.claims [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Claim successful on node user
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:01:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.policy [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fd540ceafe84c2b877de1d038b28b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e470a0a6d2f74fad84a1f1f738e8383d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:01:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Creating image(s)
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "/opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk 1073741824" returned: 0 in 0.055s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Successfully created port: 461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance destroyed successfully.
Nov 10 23:01:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Attempting rescue
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 23:01:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Creating image(s)
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Cannot resize image /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Ensure instance console log exists: /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-a22023ac-2815-4e41-b216-fbaf56f3ee42 req-6bf2ffd5-6db2-45e7-a81a-f13901c2d111 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a22023ac-2815-4e41-b216-fbaf56f3ee42 req-6bf2ffd5-6db2-45e7-a81a-f13901c2d111 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a22023ac-2815-4e41-b216-fbaf56f3ee42 req-6bf2ffd5-6db2-45e7-a81a-f13901c2d111 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a22023ac-2815-4e41-b216-fbaf56f3ee42 req-6bf2ffd5-6db2-45e7-a81a-f13901c2d111 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-a22023ac-2815-4e41-b216-fbaf56f3ee42 req-6bf2ffd5-6db2-45e7-a81a-f13901c2d111 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:03 user nova-compute[75288]: WARNING nova.compute.manager [req-a22023ac-2815-4e41-b216-fbaf56f3ee42 req-6bf2ffd5-6db2-45e7-a81a-f13901c2d111 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state active and task_state rescuing.
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue" returned: 0 in 0.052s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'migration_context' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.base [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<f1959b81-d8a2-451f-bd21-7dafe2ba297a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Start _get_guest_xml network_info=[{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:a0:db:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'resources' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Successfully updated port: 461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.base [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<f1959b81-d8a2-451f-bd21-7dafe2ba297a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'numa_topology' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquired lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.base [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<f1959b81-d8a2-451f-bd21-7dafe2ba297a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:01:03 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:03 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-changed-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Refreshing instance network info cache due to event network-changed-461abdd7-f99c-4658-a51f-459894fd78fe. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] Acquiring lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.objects.base [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<f1959b81-d8a2-451f-bd21-7dafe2ba297a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:58:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-215007874',display_name='tempest-ServerRescueNegativeTestJSON-server-215007874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-215007874',id=38,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDSC9a4Smj3mI6m3JcoREpzwGvJIoyNYgQEOB8JKXAk2RjbBuKOKfCSWhULK01Om31hJKxMNHTnkH/sIKWuNAqhmwp/MhQ6ymktOB+Raer772w07tJPebhMOl3XVlxt6Q==',key_name='tempest-keypair-1928965267',keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:58:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-xx1qth9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T22:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=f1959b81-d8a2-451f-bd21-7dafe2ba297a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:a0:db:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:01:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "vif_mac": "fa:16:3e:a0:db:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'pci_devices' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.neutron [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.objects.base [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Object Instance<f1959b81-d8a2-451f-bd21-7dafe2ba297a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:01:04 user nova-compute[75288]:   <uuid>f1959b81-d8a2-451f-bd21-7dafe2ba297a</uuid>
Nov 10 23:01:04 user nova-compute[75288]:   <name>instance-00000026</name>
Nov 10 23:01:04 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:01:04 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:01:04 user nova-compute[75288]:   <metadata>
Nov 10 23:01:04 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:01:04 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-215007874</nova:name>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:01:03</nova:creationTime>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:01:04 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:01:04 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:owner>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:user uuid="8aa64d78d0ed47e9af81121ea1e9e34a">tempest-ServerRescueNegativeTestJSON-423881024-project-member</nova:user>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:project uuid="0fb8bee5841243ecbc00a012f27016fe">tempest-ServerRescueNegativeTestJSON-423881024</nova:project>
Nov 10 23:01:04 user nova-compute[75288]:       </nova:owner>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:ports>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:port uuid="57da2b99-5561-4036-b2d0-c14f906c792c">
Nov 10 23:01:04 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 23:01:04 user nova-compute[75288]:         </nova:port>
Nov 10 23:01:04 user nova-compute[75288]:       </nova:ports>
Nov 10 23:01:04 user nova-compute[75288]:     </nova:instance>
Nov 10 23:01:04 user nova-compute[75288]:   </metadata>
Nov 10 23:01:04 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:01:04 user nova-compute[75288]:     <system>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="serial">f1959b81-d8a2-451f-bd21-7dafe2ba297a</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="uuid">f1959b81-d8a2-451f-bd21-7dafe2ba297a</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:01:04 user nova-compute[75288]:     </system>
Nov 10 23:01:04 user nova-compute[75288]:   </sysinfo>
Nov 10 23:01:04 user nova-compute[75288]:   <os>
Nov 10 23:01:04 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:01:04 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:01:04 user nova-compute[75288]:   </os>
Nov 10 23:01:04 user nova-compute[75288]:   <features>
Nov 10 23:01:04 user nova-compute[75288]:     <acpi/>
Nov 10 23:01:04 user nova-compute[75288]:     <apic/>
Nov 10 23:01:04 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:01:04 user nova-compute[75288]:   </features>
Nov 10 23:01:04 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:01:04 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:01:04 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:01:04 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:01:04 user nova-compute[75288]:   </clock>
Nov 10 23:01:04 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:01:04 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:01:04 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:01:04 user nova-compute[75288]:   </cpu>
Nov 10 23:01:04 user nova-compute[75288]:   <devices>
Nov 10 23:01:04 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:01:04 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:01:04 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue"/>
Nov 10 23:01:04 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:01:04 user nova-compute[75288]:     </disk>
Nov 10 23:01:04 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:01:04 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:01:04 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk"/>
Nov 10 23:01:04 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Nov 10 23:01:04 user nova-compute[75288]:     </disk>
Nov 10 23:01:04 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:01:04 user nova-compute[75288]:       <mac address="fa:16:3e:a0:db:0e"/>
Nov 10 23:01:04 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:01:04 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:01:04 user nova-compute[75288]:       <target dev="tap57da2b99-55"/>
Nov 10 23:01:04 user nova-compute[75288]:     </interface>
Nov 10 23:01:04 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:01:04 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/console.log" append="off"/>
Nov 10 23:01:04 user nova-compute[75288]:     </serial>
Nov 10 23:01:04 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:01:04 user nova-compute[75288]:     <video>
Nov 10 23:01:04 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:01:04 user nova-compute[75288]:     </video>
Nov 10 23:01:04 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:01:04 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:01:04 user nova-compute[75288]:     </rng>
Nov 10 23:01:04 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:01:04 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:01:04 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:01:04 user nova-compute[75288]:     </memballoon>
Nov 10 23:01:04 user nova-compute[75288]:   </devices>
Nov 10 23:01:04 user nova-compute[75288]: </domain>
Nov 10 23:01:04 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:01:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance destroyed successfully.
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] No VIF found with MAC fa:16:3e:a0:db:0e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.neutron [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updating instance_info_cache with network_info: [{"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Releasing lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Instance network_info: |[{"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] Acquired lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Refreshing network info cache for port 461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Start _get_guest_xml network_info=[{"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:01:04 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:04 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221145440',display_name='tempest-AttachVolumeNegativeTest-server-1221145440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221145440',id=39,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYP20dDVvkpaLLfwnJV1SD04z4z9ST5UnKC/rmThuFjCZbjy3IZSk/aYuckJiX81B9DZeFfqdiguVDFurDw9o2LZ9ja27ld00RmGSGQc3cx5WvA+ImFhWlHcnx2xyS5qg==',key_name='tempest-keypair-1825702553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-ju2s3jqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=67ca352f-960d-44d9-9862-06102cfb029b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:70:51,bridge_name='br-int',has_traffic_filtering=True,id=461abdd7-f99c-4658-a51f-459894fd78fe,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap461abdd7-f9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'pci_devices' on Instance uuid 67ca352f-960d-44d9-9862-06102cfb029b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:01:04 user nova-compute[75288]:   <uuid>67ca352f-960d-44d9-9862-06102cfb029b</uuid>
Nov 10 23:01:04 user nova-compute[75288]:   <name>instance-00000027</name>
Nov 10 23:01:04 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:01:04 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:01:04 user nova-compute[75288]:   <metadata>
Nov 10 23:01:04 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:01:04 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1221145440</nova:name>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:01:04</nova:creationTime>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:01:04 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:01:04 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:owner>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:user uuid="7fd540ceafe84c2b877de1d038b28b73">tempest-AttachVolumeNegativeTest-239737587-project-member</nova:user>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:project uuid="e470a0a6d2f74fad84a1f1f738e8383d">tempest-AttachVolumeNegativeTest-239737587</nova:project>
Nov 10 23:01:04 user nova-compute[75288]:       </nova:owner>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 23:01:04 user nova-compute[75288]:       <nova:ports>
Nov 10 23:01:04 user nova-compute[75288]:         <nova:port uuid="461abdd7-f99c-4658-a51f-459894fd78fe">
Nov 10 23:01:04 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 23:01:04 user nova-compute[75288]:         </nova:port>
Nov 10 23:01:04 user nova-compute[75288]:       </nova:ports>
Nov 10 23:01:04 user nova-compute[75288]:     </nova:instance>
Nov 10 23:01:04 user nova-compute[75288]:   </metadata>
Nov 10 23:01:04 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:01:04 user nova-compute[75288]:     <system>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="serial">67ca352f-960d-44d9-9862-06102cfb029b</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="uuid">67ca352f-960d-44d9-9862-06102cfb029b</entry>
Nov 10 23:01:04 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:01:04 user nova-compute[75288]:     </system>
Nov 10 23:01:04 user nova-compute[75288]:   </sysinfo>
Nov 10 23:01:04 user nova-compute[75288]:   <os>
Nov 10 23:01:04 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:01:04 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:01:04 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:01:04 user nova-compute[75288]:   </os>
Nov 10 23:01:04 user nova-compute[75288]:   <features>
Nov 10 23:01:04 user nova-compute[75288]:     <acpi/>
Nov 10 23:01:04 user nova-compute[75288]:     <apic/>
Nov 10 23:01:04 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:01:04 user nova-compute[75288]:   </features>
Nov 10 23:01:04 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:01:04 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:01:04 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:01:04 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:01:04 user nova-compute[75288]:   </clock>
Nov 10 23:01:04 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:01:04 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:01:04 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:01:04 user nova-compute[75288]:   </cpu>
Nov 10 23:01:04 user nova-compute[75288]:   <devices>
Nov 10 23:01:04 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:01:04 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:01:04 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk"/>
Nov 10 23:01:04 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:01:04 user nova-compute[75288]:     </disk>
Nov 10 23:01:04 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:01:04 user nova-compute[75288]:       <mac address="fa:16:3e:9a:70:51"/>
Nov 10 23:01:04 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:01:04 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:01:04 user nova-compute[75288]:       <target dev="tap461abdd7-f9"/>
Nov 10 23:01:04 user nova-compute[75288]:     </interface>
Nov 10 23:01:04 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:01:04 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/console.log" append="off"/>
Nov 10 23:01:04 user nova-compute[75288]:     </serial>
Nov 10 23:01:04 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:01:04 user nova-compute[75288]:     <video>
Nov 10 23:01:04 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:01:04 user nova-compute[75288]:     </video>
Nov 10 23:01:04 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:01:04 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:01:04 user nova-compute[75288]:     </rng>
Nov 10 23:01:04 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:01:04 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:01:04 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:01:04 user nova-compute[75288]:     </memballoon>
Nov 10 23:01:04 user nova-compute[75288]:   </devices>
Nov 10 23:01:04 user nova-compute[75288]: </domain>
Nov 10 23:01:04 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221145440',display_name='tempest-AttachVolumeNegativeTest-server-1221145440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221145440',id=39,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYP20dDVvkpaLLfwnJV1SD04z4z9ST5UnKC/rmThuFjCZbjy3IZSk/aYuckJiX81B9DZeFfqdiguVDFurDw9o2LZ9ja27ld00RmGSGQc3cx5WvA+ImFhWlHcnx2xyS5qg==',key_name='tempest-keypair-1825702553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-ju2s3jqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=67ca352f-960d-44d9-9862-06102cfb029b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:70:51,bridge_name='br-int',has_traffic_filtering=True,id=461abdd7-f99c-4658-a51f-459894fd78fe,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap461abdd7-f9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG os_vif [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:70:51,bridge_name='br-int',has_traffic_filtering=True,id=461abdd7-f99c-4658-a51f-459894fd78fe,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap461abdd7-f9') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f01077f4-3a54-5a68-b885-9a407992578c', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap461abdd7-f9, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap461abdd7-f9, col_values=(('qos', UUID('1db9a22b-c0d0-4157-b445-aa658b6e4c84')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap461abdd7-f9, col_values=(('external_ids', {'iface-id': '461abdd7-f99c-4658-a51f-459894fd78fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:70:51', 'vm-uuid': '67ca352f-960d-44d9-9862-06102cfb029b'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:04 user nova-compute[75288]: INFO os_vif [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:70:51,bridge_name='br-int',has_traffic_filtering=True,id=461abdd7-f99c-4658-a51f-459894fd78fe,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap461abdd7-f9')
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:01:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No VIF found with MAC fa:16:3e:9a:70:51, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:01:05 user nova-compute[75288]: DEBUG nova.network.neutron [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updated VIF entry in instance network info cache for port 461abdd7-f99c-4658-a51f-459894fd78fe. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:01:05 user nova-compute[75288]: DEBUG nova.network.neutron [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updating instance_info_cache with network_info: [{"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:01:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-781a5ec5-a54a-45ea-b25f-e76d9761cfdb req-c023b270-8fef-4f8c-8cf3-3c5d0cd342f8 service nova] Releasing lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:01:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-73011725-1c3c-47c9-b685-78e153f8bf61 req-e52314bc-0f0a-4610-b7c6-29a3111bfb07 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73011725-1c3c-47c9-b685-78e153f8bf61 req-e52314bc-0f0a-4610-b7c6-29a3111bfb07 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73011725-1c3c-47c9-b685-78e153f8bf61 req-e52314bc-0f0a-4610-b7c6-29a3111bfb07 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73011725-1c3c-47c9-b685-78e153f8bf61 req-e52314bc-0f0a-4610-b7c6-29a3111bfb07 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-73011725-1c3c-47c9-b685-78e153f8bf61 req-e52314bc-0f0a-4610-b7c6-29a3111bfb07 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:06 user nova-compute[75288]: WARNING nova.compute.manager [req-73011725-1c3c-47c9-b685-78e153f8bf61 req-e52314bc-0f0a-4610-b7c6-29a3111bfb07 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state active and task_state rescuing.
Nov 10 23:01:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-1160cf1b-c89b-4023-94c2-75150d9753d7 req-01d74ab9-443d-4db3-aa91-613b5d445785 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1160cf1b-c89b-4023-94c2-75150d9753d7 req-01d74ab9-443d-4db3-aa91-613b5d445785 service nova] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1160cf1b-c89b-4023-94c2-75150d9753d7 req-01d74ab9-443d-4db3-aa91-613b5d445785 service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1160cf1b-c89b-4023-94c2-75150d9753d7 req-01d74ab9-443d-4db3-aa91-613b5d445785 service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-1160cf1b-c89b-4023-94c2-75150d9753d7 req-01d74ab9-443d-4db3-aa91-613b5d445785 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] No waiting events found dispatching network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:07 user nova-compute[75288]: WARNING nova.compute.manager [req-1160cf1b-c89b-4023-94c2-75150d9753d7 req-01d74ab9-443d-4db3-aa91-613b5d445785 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received unexpected event network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe for instance with vm_state building and task_state spawning.
Nov 10 23:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 23:01:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance has had 3 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 23:01:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Deletion of /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize failed
Nov 10 23:01:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:08 user nova-compute[75288]: WARNING nova.compute.manager [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state active and task_state rescuing.
Nov 10 23:01:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:08 user nova-compute[75288]: WARNING nova.compute.manager [req-73b6789c-a727-47d8-860d-ca5ea124825a req-525a6e3a-99ed-4245-94e0-3eb753950403 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state active and task_state rescuing.
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-ac18ebfa-056f-4670-afa3-cdcbbe33f229 req-656dbb26-b4d5-447b-8b7f-29e00968d670 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ac18ebfa-056f-4670-afa3-cdcbbe33f229 req-656dbb26-b4d5-447b-8b7f-29e00968d670 service nova] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ac18ebfa-056f-4670-afa3-cdcbbe33f229 req-656dbb26-b4d5-447b-8b7f-29e00968d670 service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ac18ebfa-056f-4670-afa3-cdcbbe33f229 req-656dbb26-b4d5-447b-8b7f-29e00968d670 service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-ac18ebfa-056f-4670-afa3-cdcbbe33f229 req-656dbb26-b4d5-447b-8b7f-29e00968d670 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] No waiting events found dispatching network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:09 user nova-compute[75288]: WARNING nova.compute.manager [req-ac18ebfa-056f-4670-afa3-cdcbbe33f229 req-656dbb26-b4d5-447b-8b7f-29e00968d670 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received unexpected event network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe for instance with vm_state building and task_state spawning.
Nov 10 23:01:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:01:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Instance spawned successfully.
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9c35164e-c7ad-4035-9717-810ccb3beebb tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:01:09 user nova-compute[75288]: INFO nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 10 23:01:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:01:10 user nova-compute[75288]: INFO nova.compute.manager [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Took 8.00 seconds to build instance.
Nov 10 23:01:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-22dc49fb-7991-4369-b679-4ee15fca772f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.105s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:01:16 user nova-compute[75288]: INFO nova.compute.claims [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Claim successful on node user
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:01:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.policy [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86919732056405e8f8da616270f2672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0485db81ce8748b1b2bf3b8e907cdc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:01:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Creating image(s)
Nov 10 23:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "/opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "/opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "/opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "ca2907109b2f28eec9b46a2e53cb056451f87da5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "ca2907109b2f28eec9b46a2e53cb056451f87da5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Successfully created port: f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG nova.virt.images [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] 3d0b8ec2-174b-4b1a-966c-70c0afd993ef was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.part /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.part /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.converted" returned: 0 in 0.211s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "ca2907109b2f28eec9b46a2e53cb056451f87da5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.162s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Successfully updated port: f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5 --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "ca2907109b2f28eec9b46a2e53cb056451f87da5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "ca2907109b2f28eec9b46a2e53cb056451f87da5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing instance network info cache due to event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5 --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5,backing_fmt=raw /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5,backing_fmt=raw /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk 1073741824" returned: 0 in 0.075s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "ca2907109b2f28eec9b46a2e53cb056451f87da5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4ecdb971-7acd-4210-9484-d6630d81ef01 req-3bf3459a-4b46-485e-996b-e9b7aa708cb9 service nova] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5 --force-share --output=json" returned: 0 in 0.220s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Cannot resize image /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Ensure instance console log exists: /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance network_info: |[{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Start _get_guest_xml network_info=[{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:01:13Z,direct_url=<?>,disk_format='qcow2',id=3d0b8ec2-174b-4b1a-966c-70c0afd993ef,min_disk=0,min_ram=0,name='tempest-scenario-img--409605665',owner='0485db81ce8748b1b2bf3b8e907cdc5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:01:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': '3d0b8ec2-174b-4b1a-966c-70c0afd993ef'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:01:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T23:01:13Z,direct_url=<?>,disk_format='qcow2',id=3d0b8ec2-174b-4b1a-966c-70c0afd993ef,min_disk=0,min_ram=0,name='tempest-scenario-img--409605665',owner='0485db81ce8748b1b2bf3b8e907cdc5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T23:01:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1887113788',display_name='tempest-TestMinimumBasicScenario-server-1887113788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1887113788',id=40,image_ref='3d0b8ec2-174b-4b1a-966c-70c0afd993ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMll2H55Gg3hUsRCAQc3zyK60WPSjdMvp/wfwqvsasG2mToNWc0iQwHv7ZVHFvsDPR2nCpt49hdfvUM7AOX7YZg3KcdQraaMnp6V/XGt5YVdzWfdpaSH2nhtKTqcZsveOA==',key_name='tempest-TestMinimumBasicScenario-1252083279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-tsfsx3og',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3d0b8ec2-174b-4b1a-966c-70c0afd993ef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:01:17Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=45ef67d8-4ef2-4481-85e2-fa12d115fe60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:71:08,bridge_name='br-int',has_traffic_filtering=True,id=f26f08ec-0757-4da3-8f06-2cf07dadbbcf,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26f08ec-07') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'pci_devices' on Instance uuid 45ef67d8-4ef2-4481-85e2-fa12d115fe60 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:01:19 user nova-compute[75288]:   <uuid>45ef67d8-4ef2-4481-85e2-fa12d115fe60</uuid>
Nov 10 23:01:19 user nova-compute[75288]:   <name>instance-00000028</name>
Nov 10 23:01:19 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:01:19 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:01:19 user nova-compute[75288]:   <metadata>
Nov 10 23:01:19 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:01:19 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:01:19 user nova-compute[75288]:       <nova:name>tempest-TestMinimumBasicScenario-server-1887113788</nova:name>
Nov 10 23:01:19 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:01:19</nova:creationTime>
Nov 10 23:01:19 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:01:19 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:01:19 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:01:19 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:01:19 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:01:19 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:01:19 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:01:19 user nova-compute[75288]:       <nova:owner>
Nov 10 23:01:19 user nova-compute[75288]:         <nova:user uuid="f86919732056405e8f8da616270f2672">tempest-TestMinimumBasicScenario-519527003-project-member</nova:user>
Nov 10 23:01:19 user nova-compute[75288]:         <nova:project uuid="0485db81ce8748b1b2bf3b8e907cdc5a">tempest-TestMinimumBasicScenario-519527003</nova:project>
Nov 10 23:01:19 user nova-compute[75288]:       </nova:owner>
Nov 10 23:01:19 user nova-compute[75288]:       <nova:root type="image" uuid="3d0b8ec2-174b-4b1a-966c-70c0afd993ef"/>
Nov 10 23:01:19 user nova-compute[75288]:       <nova:ports>
Nov 10 23:01:19 user nova-compute[75288]:         <nova:port uuid="f26f08ec-0757-4da3-8f06-2cf07dadbbcf">
Nov 10 23:01:19 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 23:01:19 user nova-compute[75288]:         </nova:port>
Nov 10 23:01:19 user nova-compute[75288]:       </nova:ports>
Nov 10 23:01:19 user nova-compute[75288]:     </nova:instance>
Nov 10 23:01:19 user nova-compute[75288]:   </metadata>
Nov 10 23:01:19 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:01:19 user nova-compute[75288]:     <system>
Nov 10 23:01:19 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:01:19 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:01:19 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:01:19 user nova-compute[75288]:       <entry name="serial">45ef67d8-4ef2-4481-85e2-fa12d115fe60</entry>
Nov 10 23:01:19 user nova-compute[75288]:       <entry name="uuid">45ef67d8-4ef2-4481-85e2-fa12d115fe60</entry>
Nov 10 23:01:19 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:01:19 user nova-compute[75288]:     </system>
Nov 10 23:01:19 user nova-compute[75288]:   </sysinfo>
Nov 10 23:01:19 user nova-compute[75288]:   <os>
Nov 10 23:01:19 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:01:19 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:01:19 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:01:19 user nova-compute[75288]:   </os>
Nov 10 23:01:19 user nova-compute[75288]:   <features>
Nov 10 23:01:19 user nova-compute[75288]:     <acpi/>
Nov 10 23:01:19 user nova-compute[75288]:     <apic/>
Nov 10 23:01:19 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:01:19 user nova-compute[75288]:   </features>
Nov 10 23:01:19 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:01:19 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:01:19 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:01:19 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:01:19 user nova-compute[75288]:   </clock>
Nov 10 23:01:19 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:01:19 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:01:19 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:01:19 user nova-compute[75288]:   </cpu>
Nov 10 23:01:19 user nova-compute[75288]:   <devices>
Nov 10 23:01:19 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:01:19 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:01:19 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk"/>
Nov 10 23:01:19 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:01:19 user nova-compute[75288]:     </disk>
Nov 10 23:01:19 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:01:19 user nova-compute[75288]:       <mac address="fa:16:3e:84:71:08"/>
Nov 10 23:01:19 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:01:19 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:01:19 user nova-compute[75288]:       <target dev="tapf26f08ec-07"/>
Nov 10 23:01:19 user nova-compute[75288]:     </interface>
Nov 10 23:01:19 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:01:19 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/console.log" append="off"/>
Nov 10 23:01:19 user nova-compute[75288]:     </serial>
Nov 10 23:01:19 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:01:19 user nova-compute[75288]:     <video>
Nov 10 23:01:19 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:01:19 user nova-compute[75288]:     </video>
Nov 10 23:01:19 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:01:19 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:01:19 user nova-compute[75288]:     </rng>
Nov 10 23:01:19 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:01:19 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:01:19 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:01:19 user nova-compute[75288]:     </memballoon>
Nov 10 23:01:19 user nova-compute[75288]:   </devices>
Nov 10 23:01:19 user nova-compute[75288]: </domain>
Nov 10 23:01:19 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1887113788',display_name='tempest-TestMinimumBasicScenario-server-1887113788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1887113788',id=40,image_ref='3d0b8ec2-174b-4b1a-966c-70c0afd993ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMll2H55Gg3hUsRCAQc3zyK60WPSjdMvp/wfwqvsasG2mToNWc0iQwHv7ZVHFvsDPR2nCpt49hdfvUM7AOX7YZg3KcdQraaMnp6V/XGt5YVdzWfdpaSH2nhtKTqcZsveOA==',key_name='tempest-TestMinimumBasicScenario-1252083279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-tsfsx3og',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3d0b8ec2-174b-4b1a-966c-70c0afd993ef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:01:17Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=45ef67d8-4ef2-4481-85e2-fa12d115fe60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:71:08,bridge_name='br-int',has_traffic_filtering=True,id=f26f08ec-0757-4da3-8f06-2cf07dadbbcf,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26f08ec-07') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG os_vif [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:71:08,bridge_name='br-int',has_traffic_filtering=True,id=f26f08ec-0757-4da3-8f06-2cf07dadbbcf,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26f08ec-07') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1543872b-725c-5e11-af1e-41e9620d2d75', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf26f08ec-07, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf26f08ec-07, col_values=(('qos', UUID('592bd4cd-76af-48cd-94fc-aff0030ca981')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf26f08ec-07, col_values=(('external_ids', {'iface-id': 'f26f08ec-0757-4da3-8f06-2cf07dadbbcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:71:08', 'vm-uuid': '45ef67d8-4ef2-4481-85e2-fa12d115fe60'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:19 user nova-compute[75288]: INFO os_vif [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:71:08,bridge_name='br-int',has_traffic_filtering=True,id=f26f08ec-0757-4da3-8f06-2cf07dadbbcf,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26f08ec-07')
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:01:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No VIF found with MAC fa:16:3e:84:71:08, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-d7b52cde-aef9-4ce8-983f-d2fc246eceff req-09f26032-23c0-4a75-b0fc-09e7c3ed8978 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d7b52cde-aef9-4ce8-983f-d2fc246eceff req-09f26032-23c0-4a75-b0fc-09e7c3ed8978 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d7b52cde-aef9-4ce8-983f-d2fc246eceff req-09f26032-23c0-4a75-b0fc-09e7c3ed8978 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d7b52cde-aef9-4ce8-983f-d2fc246eceff req-09f26032-23c0-4a75-b0fc-09e7c3ed8978 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-d7b52cde-aef9-4ce8-983f-d2fc246eceff req-09f26032-23c0-4a75-b0fc-09e7c3ed8978 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:21 user nova-compute[75288]: WARNING nova.compute.manager [req-d7b52cde-aef9-4ce8-983f-d2fc246eceff req-09f26032-23c0-4a75-b0fc-09e7c3ed8978 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state building and task_state spawning.
Nov 10 23:01:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 67ca352f-960d-44d9-9862-06102cfb029b {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 45ef67d8-4ef2-4481-85e2-fa12d115fe60 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "67ca352f-960d-44d9-9862-06102cfb029b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "67ca352f-960d-44d9-9862-06102cfb029b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-e7ce71f0-28f8-440f-abe6-9b8f0df65c09 req-4b6ae826-8a85-46eb-9060-295d7b56dce3 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e7ce71f0-28f8-440f-abe6-9b8f0df65c09 req-4b6ae826-8a85-46eb-9060-295d7b56dce3 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e7ce71f0-28f8-440f-abe6-9b8f0df65c09 req-4b6ae826-8a85-46eb-9060-295d7b56dce3 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e7ce71f0-28f8-440f-abe6-9b8f0df65c09 req-4b6ae826-8a85-46eb-9060-295d7b56dce3 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-e7ce71f0-28f8-440f-abe6-9b8f0df65c09 req-4b6ae826-8a85-46eb-9060-295d7b56dce3 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:01:23 user nova-compute[75288]: WARNING nova.compute.manager [req-e7ce71f0-28f8-440f-abe6-9b8f0df65c09 req-4b6ae826-8a85-46eb-9060-295d7b56dce3 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state building and task_state spawning.
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:01:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance spawned successfully.
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:01:23 user nova-compute[75288]: INFO nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 10 23:01:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:01:23 user nova-compute[75288]: INFO nova.compute.manager [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Took 7.33 seconds to build instance.
Nov 10 23:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2deaff07-423a-4f5e-9117-2dd79e97c223 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.480s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.637s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:23 user nova-compute[75288]: INFO nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 10 23:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:01:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:01:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8234MB free_disk=25.009395599365234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f1959b81-d8a2-451f-bd21-7dafe2ba297a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 67ca352f-960d-44d9-9862-06102cfb029b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:01:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:01:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:01:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:01:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:01:59 user nova-compute[75288]: INFO nova.compute.claims [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Claim successful on node user
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:02:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.policy [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09d92fe49e244ab1a8d44d44e350dc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4405c403b8e4365975b2b3a885c5146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:02:00 user nova-compute[75288]: INFO nova.virt.block_device [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Booting with volume b1276ebc-9789-44a6-bad2-122e46529aae at /dev/vda
Nov 10 23:02:00 user nova-compute[75288]: DEBUG os_brick.utils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1d9d44-502f-4701-8dc6-7eee3e2df213]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43ce234-90b8-45ea-a282-d608abd486ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[20def8b2-5bc4-411a-bf8f-fe10ad036d24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1295bf15-bd80-4f9e-8482-dc29c00d66b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:02:00 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:02:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db972b6c-b9dd-4ec0-a2a1-c0376101b27f]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG os_brick.utils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating existing volume attachment record: ead0a1e0-1876-40ec-b01b-c11219370882 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Successfully created port: e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Successfully updated port: e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing instance network info cache due to event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:02:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance network_info: |[{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updated VIF entry in instance network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:02:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0ce00048-e2d5-4517-bb4b-eb198b28dea1 req-47b66732-dda0-4ef2-8637-9069b473e7a7 service nova] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:02:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:02:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:02:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:02:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:02:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:02:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Creating image(s)
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Ensure instance console log exists: /opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Start _get_guest_xml network_info=[{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73b43004-5b50-4f05-a082-d59af20b6496', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1276ebc-9789-44a6-bad2-122e46529aae', 'serial': 'b1276ebc-9789-44a6-bad2-122e46529aae'}, 'mount_device': '/dev/vda', 'attachment_id': 'ead0a1e0-1876-40ec-b01b-c11219370882', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:02:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:02:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:02:25 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:02:25 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:02:25 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab5be9d-02b4-4eaf-b52d-dc02ceb846b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:02:25 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[254aef2c-1dee-4415-be16-6836641f3f70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae] added
Nov 10 23:02:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e252bdc2-9c82-4581-b598-68b89271a4a6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5fab5-b0a0-428b-976d-2d6eb0269d16]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASpCPGcK {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASpCPGcK" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[858c0a5f-bf24-4aa8-a56a-543181f93f07]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASpCPGcK'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f5c2d-1f52-4806-ba85-2bd12176a049]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f1ef0-66fc-4619-9916-9ca3c67cfa76]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:02:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:02:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b7c7a2-bd5f-4f68-8de0-fbe57ba4a611]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]
Nov 10 23:02:25 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.
Nov 10 23:02:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c512f96f-2edd-444d-84d5-42633c6a7331]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55fc830-dbf6-4d13-885a-9fcca4846b82]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:02:25 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:02:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:02:25 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:02:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b49c1-420f-4782-90b3-f2c56b5f307e]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:02:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23138393930346466', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138393930346466', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960437778',display_name='tempest-TestShelveInstance-server-1960437778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960437778',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmHVhExr7lbPtKRyZtoqtSU9E8RUajl8Qyppo53C1XB8xNneYgr6uru5V34zaHL25eMCX0WUN3DkjLNm5CAe5hSb3SM0bmE0S1nZrMWaacHmic/leLzCjMKETJErw30lA==',key_name='tempest-TestShelveInstance-851294927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4405c403b8e4365975b2b3a885c5146',ramdisk_id='',reservation_id='r-hw7cn7zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-872213000',owner_user_name='tempest-TestShelveInstance-872213000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:02:00Z,user_data=None,user_id='09d92fe49e244ab1a8d44d44e350dc51',uuid=73b43004-5b50-4f05-a082-d59af20b6496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converting VIF {"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'pci_devices' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:02:26 user nova-compute[75288]:   <uuid>73b43004-5b50-4f05-a082-d59af20b6496</uuid>
Nov 10 23:02:26 user nova-compute[75288]:   <name>instance-00000029</name>
Nov 10 23:02:26 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:02:26 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:02:26 user nova-compute[75288]:   <metadata>
Nov 10 23:02:26 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:02:26 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:02:26 user nova-compute[75288]:       <nova:name>tempest-TestShelveInstance-server-1960437778</nova:name>
Nov 10 23:02:26 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:02:25</nova:creationTime>
Nov 10 23:02:26 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:02:26 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:02:26 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:02:26 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:02:26 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:02:26 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:02:26 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:02:26 user nova-compute[75288]:       <nova:owner>
Nov 10 23:02:26 user nova-compute[75288]:         <nova:user uuid="09d92fe49e244ab1a8d44d44e350dc51">tempest-TestShelveInstance-872213000-project-member</nova:user>
Nov 10 23:02:26 user nova-compute[75288]:         <nova:project uuid="f4405c403b8e4365975b2b3a885c5146">tempest-TestShelveInstance-872213000</nova:project>
Nov 10 23:02:26 user nova-compute[75288]:       </nova:owner>
Nov 10 23:02:26 user nova-compute[75288]:       <nova:ports>
Nov 10 23:02:26 user nova-compute[75288]:         <nova:port uuid="e66bcde8-1a94-4b2b-b7f5-852a754c8f5d">
Nov 10 23:02:26 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 23:02:26 user nova-compute[75288]:         </nova:port>
Nov 10 23:02:26 user nova-compute[75288]:       </nova:ports>
Nov 10 23:02:26 user nova-compute[75288]:     </nova:instance>
Nov 10 23:02:26 user nova-compute[75288]:   </metadata>
Nov 10 23:02:26 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:02:26 user nova-compute[75288]:     <system>
Nov 10 23:02:26 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:02:26 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:02:26 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:02:26 user nova-compute[75288]:       <entry name="serial">73b43004-5b50-4f05-a082-d59af20b6496</entry>
Nov 10 23:02:26 user nova-compute[75288]:       <entry name="uuid">73b43004-5b50-4f05-a082-d59af20b6496</entry>
Nov 10 23:02:26 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:02:26 user nova-compute[75288]:     </system>
Nov 10 23:02:26 user nova-compute[75288]:   </sysinfo>
Nov 10 23:02:26 user nova-compute[75288]:   <os>
Nov 10 23:02:26 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:02:26 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:02:26 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:02:26 user nova-compute[75288]:   </os>
Nov 10 23:02:26 user nova-compute[75288]:   <features>
Nov 10 23:02:26 user nova-compute[75288]:     <acpi/>
Nov 10 23:02:26 user nova-compute[75288]:     <apic/>
Nov 10 23:02:26 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:02:26 user nova-compute[75288]:   </features>
Nov 10 23:02:26 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:02:26 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:02:26 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:02:26 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:02:26 user nova-compute[75288]:   </clock>
Nov 10 23:02:26 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:02:26 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:02:26 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:02:26 user nova-compute[75288]:   </cpu>
Nov 10 23:02:26 user nova-compute[75288]:   <devices>
Nov 10 23:02:26 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 23:02:26 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:02:26 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Nov 10 23:02:26 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:02:26 user nova-compute[75288]:       <serial>b1276ebc-9789-44a6-bad2-122e46529aae</serial>
Nov 10 23:02:26 user nova-compute[75288]:     </disk>
Nov 10 23:02:26 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:02:26 user nova-compute[75288]:       <mac address="fa:16:3e:3a:1c:b7"/>
Nov 10 23:02:26 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:02:26 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:02:26 user nova-compute[75288]:       <target dev="tape66bcde8-1a"/>
Nov 10 23:02:26 user nova-compute[75288]:     </interface>
Nov 10 23:02:26 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:02:26 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496/console.log" append="off"/>
Nov 10 23:02:26 user nova-compute[75288]:     </serial>
Nov 10 23:02:26 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:02:26 user nova-compute[75288]:     <video>
Nov 10 23:02:26 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:02:26 user nova-compute[75288]:     </video>
Nov 10 23:02:26 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:02:26 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:02:26 user nova-compute[75288]:     </rng>
Nov 10 23:02:26 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:02:26 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:02:26 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:02:26 user nova-compute[75288]:     </memballoon>
Nov 10 23:02:26 user nova-compute[75288]:   </devices>
Nov 10 23:02:26 user nova-compute[75288]: </domain>
Nov 10 23:02:26 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960437778',display_name='tempest-TestShelveInstance-server-1960437778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960437778',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmHVhExr7lbPtKRyZtoqtSU9E8RUajl8Qyppo53C1XB8xNneYgr6uru5V34zaHL25eMCX0WUN3DkjLNm5CAe5hSb3SM0bmE0S1nZrMWaacHmic/leLzCjMKETJErw30lA==',key_name='tempest-TestShelveInstance-851294927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4405c403b8e4365975b2b3a885c5146',ramdisk_id='',reservation_id='r-hw7cn7zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-872213000',owner_user_name='tempest-TestShelveInstance-872213000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:02:00Z,user_data=None,user_id='09d92fe49e244ab1a8d44d44e350dc51',uuid=73b43004-5b50-4f05-a082-d59af20b6496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converting VIF {"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG os_vif [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90684a06-3de1-579a-a804-104006020540', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape66bcde8-1a, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape66bcde8-1a, col_values=(('qos', UUID('118d5fbc-35fb-4481-9639-3b347076b99b')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape66bcde8-1a, col_values=(('external_ids', {'iface-id': 'e66bcde8-1a94-4b2b-b7f5-852a754c8f5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:1c:b7', 'vm-uuid': '73b43004-5b50-4f05-a082-d59af20b6496'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:26 user nova-compute[75288]: INFO os_vif [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a')
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:02:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] No VIF found with MAC fa:16:3e:3a:1c:b7, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-b0f69ce2-2550-4c4e-a76d-6cdc44fddc05 req-360af571-4eb1-4b4d-a272-f2fb8a481219 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0f69ce2-2550-4c4e-a76d-6cdc44fddc05 req-360af571-4eb1-4b4d-a272-f2fb8a481219 service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0f69ce2-2550-4c4e-a76d-6cdc44fddc05 req-360af571-4eb1-4b4d-a272-f2fb8a481219 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0f69ce2-2550-4c4e-a76d-6cdc44fddc05 req-360af571-4eb1-4b4d-a272-f2fb8a481219 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-b0f69ce2-2550-4c4e-a76d-6cdc44fddc05 req-360af571-4eb1-4b4d-a272-f2fb8a481219 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:02:28 user nova-compute[75288]: WARNING nova.compute.manager [req-b0f69ce2-2550-4c4e-a76d-6cdc44fddc05 req-360af571-4eb1-4b4d-a272-f2fb8a481219 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received unexpected event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with vm_state building and task_state spawning.
Nov 10 23:02:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:02:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance spawned successfully.
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:02:30 user nova-compute[75288]: INFO nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:02:30 user nova-compute[75288]: INFO nova.compute.manager [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Took 30.82 seconds to build instance.
Nov 10 23:02:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-354aad8f-3fc5-4663-9a1e-9245a010c294 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.943s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-5cf15e8b-7e6e-48ac-b67b-c3acdac95b82 req-5fa9e77b-3c7b-4dfa-9668-824a65b88ce8 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5cf15e8b-7e6e-48ac-b67b-c3acdac95b82 req-5fa9e77b-3c7b-4dfa-9668-824a65b88ce8 service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5cf15e8b-7e6e-48ac-b67b-c3acdac95b82 req-5fa9e77b-3c7b-4dfa-9668-824a65b88ce8 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5cf15e8b-7e6e-48ac-b67b-c3acdac95b82 req-5fa9e77b-3c7b-4dfa-9668-824a65b88ce8 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-5cf15e8b-7e6e-48ac-b67b-c3acdac95b82 req-5fa9e77b-3c7b-4dfa-9668-824a65b88ce8 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:02:30 user nova-compute[75288]: WARNING nova.compute.manager [req-5cf15e8b-7e6e-48ac-b67b-c3acdac95b82 req-5fa9e77b-3c7b-4dfa-9668-824a65b88ce8 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received unexpected event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with vm_state active and task_state None.
Nov 10 23:02:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:02:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:02:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:02:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8234MB free_disk=24.97815704345703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f1959b81-d8a2-451f-bd21-7dafe2ba297a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 67ca352f-960d-44d9-9862-06102cfb029b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 73b43004-5b50-4f05-a082-d59af20b6496 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:02:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:02:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:02:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:02:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:02:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updating instance_info_cache with network_info: [{"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:02:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-ad132b9c-5de3-4d1a-ab55-4e95d589df45" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:02:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:02:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:02:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:02:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:52 user nova-compute[75288]: INFO nova.compute.manager [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Unrescuing
Nov 10 23:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:02:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:02:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-changed-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Refreshing instance network info cache due to event network-changed-461abdd7-f99c-4658-a51f-459894fd78fe. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] Acquiring lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] Acquired lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:02:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Refreshing network info cache for port 461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updated VIF entry in instance network info cache for port 461abdd7-f99c-4658-a51f-459894fd78fe. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updating instance_info_cache with network_info: [{"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'flavor' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8ee313c6-8778-4074-8308-4ffa2a48fa1c req-92496eeb-7b96-4a00-9480-f1a32cc58cd6 service nova] Releasing lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-10bf0e71-1cca-4b59-8d8d-fa57a0fe5705 req-53fb5b12-db43-44f7-804e-bc2002060a76 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10bf0e71-1cca-4b59-8d8d-fa57a0fe5705 req-53fb5b12-db43-44f7-804e-bc2002060a76 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10bf0e71-1cca-4b59-8d8d-fa57a0fe5705 req-53fb5b12-db43-44f7-804e-bc2002060a76 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10bf0e71-1cca-4b59-8d8d-fa57a0fe5705 req-53fb5b12-db43-44f7-804e-bc2002060a76 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-10bf0e71-1cca-4b59-8d8d-fa57a0fe5705 req-53fb5b12-db43-44f7-804e-bc2002060a76 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:02:53 user nova-compute[75288]: WARNING nova.compute.manager [req-10bf0e71-1cca-4b59-8d8d-fa57a0fe5705 req-53fb5b12-db43-44f7-804e-bc2002060a76 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state rescued and task_state unrescuing.
Nov 10 23:02:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance destroyed successfully.
Nov 10 23:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:02:55 user nova-compute[75288]: WARNING nova.compute.manager [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state rescued and task_state unrescuing.
Nov 10 23:02:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:02:55 user nova-compute[75288]: WARNING nova.compute.manager [req-01882e0a-0add-4451-881d-1bed033b21be req-38f650e9-4c2b-4203-92de-180a5d8b4a17 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state rescued and task_state unrescuing.
Nov 10 23:02:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-c0ad5a7f-5c50-458a-8f5e-9b2baa8d00ff tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:02:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-a263f5fc-e6c5-407c-a41b-f88795ec9909 req-5d39f713-7947-470e-8974-08b000c69528 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:02:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a263f5fc-e6c5-407c-a41b-f88795ec9909 req-5d39f713-7947-470e-8974-08b000c69528 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a263f5fc-e6c5-407c-a41b-f88795ec9909 req-5d39f713-7947-470e-8974-08b000c69528 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a263f5fc-e6c5-407c-a41b-f88795ec9909 req-5d39f713-7947-470e-8974-08b000c69528 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-a263f5fc-e6c5-407c-a41b-f88795ec9909 req-5d39f713-7947-470e-8974-08b000c69528 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:02:57 user nova-compute[75288]: WARNING nova.compute.manager [req-a263f5fc-e6c5-407c-a41b-f88795ec9909 req-5d39f713-7947-470e-8974-08b000c69528 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state rescued and task_state unrescuing.
Nov 10 23:02:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:02:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 67ca352f-960d-44d9-9862-06102cfb029b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:00 user nova-compute[75288]: INFO nova.compute.manager [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Attaching volume 2da91226-7c43-4330-b3b6-a9194c91e823 to /dev/vdb
Nov 10 23:03:00 user nova-compute[75288]: DEBUG os_brick.utils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eb9dac-8464-41c9-be3d-ace1f8db0495]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e494147a-dda7-46db-9cb8-c16a054ef833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[94294387-a35d-4a25-9df1-bae471148ecf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db8f12-dfc1-4b5e-ba88-f5bf0e0de180]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:03:00 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:03:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed239d9-a306-44b4-9f60-71d54b186919]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG os_brick.utils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:03:00 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updating existing volume attachment record: 42eb2f52-8534-4bf7-ae1f-52c351b31b67 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:03:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'flavor' on Instance uuid 45ef67d8-4ef2-4481-85e2-fa12d115fe60 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:03:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:13 user nova-compute[75288]: INFO nova.compute.manager [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Attaching volume 8da5a310-0f29-4da2-a61e-6024a0bfe45a to /dev/vdb
Nov 10 23:03:13 user nova-compute[75288]: DEBUG os_brick.utils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd70bb88-5dc5-4257-8196-7302262eb3d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c58241c-c822-4ae4-9272-f26e89a61862]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08012f6-26c0-4413-b8a6-079165b37b5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cf52d5-2d74-42b5-a365-15e99247ffa9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:03:13 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:03:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32f6b06-56ca-491a-9a35-3d6bfbcc5c35]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG os_brick.utils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:03:13 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating existing volume attachment record: b8ee278a-eea0-4192-910a-cb809acb54cd {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:03:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnsVrRpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:03:37 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:03:37 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:03:37 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e1d5d-d2e9-4026-8ead-94b6ee2f0704]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:03:37 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78909bb-3a7b-4086-983b-27934bd6cdae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a] added
Nov 10 23:03:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3500188d-31be-45aa-9a9e-17b42884aaec]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7133d792-c04a-4313-9408-3ff0c58f3797]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnsVrRpF {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnsVrRpF" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cafe77e-e1ed-4ad5-b103-390eb402f339]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EnsVrRpF'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f677f-e726-4c8b-88a3-5dc6d50e700a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b19c4-248f-47cf-9c84-3ebbcc3fb1c8]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:37 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:37 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b7b894-b01b-421d-8a99-31c921b55cf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260]
Nov 10 23:03:37 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260] successful.
Nov 10 23:03:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a2bf2-6c02-42fd-9f90-731719c93619]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc3b14-9ab0-41a6-93a5-87783f3c7943]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:37 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:37 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:37 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:37 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6cd1a7-37ee-4243-aaf8-23e94a9113e6]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:03:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:03:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnsVrRpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:03:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:03:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23463343734376365', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:03:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463343734376365', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:03:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'flavor' on Instance uuid 45ef67d8-4ef2-4481-85e2-fa12d115fe60 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:03:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 23:03:38 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:03:38 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 23:03:38 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:03:38 user nova-compute[75288]:   <serial>8da5a310-0f29-4da2-a61e-6024a0bfe45a</serial>
Nov 10 23:03:38 user nova-compute[75288]: </disk>
Nov 10 23:03:38 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 23:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] No VIF found with MAC fa:16:3e:84:71:08, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:03:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c8792a7-45fd-4f4d-b6e0-772fe5e4f935 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.493s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:03:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing instance network info cache due to event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snHkXpoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:03:42 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:03:42 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:03:42 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b1fcc7-ff14-4ce0-b436-a68ac3b8d58f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:03:42 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96d4f8-a56c-43c1-a893-f629fa5ba8d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823] added
Nov 10 23:03:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updated VIF entry in instance network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b66d480-cea8-42d6-b983-2f945bf9ee39]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1da0bdcd-71a9-4ee2-a77c-781e011870cf req-e0c7c18d-3f4c-49fa-94dc-c915f0895a22 service nova] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b517971-4d63-4816-af08-5bd8d048806e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snHkXpoK {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snHkXpoK" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3dd5f9-4347-4904-8f35-e80a1a434aa7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snHkXpoK'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cdb76d-6182-4125-891c-1c79f5394af6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3ad41b-7e89-4d38-8e9d-ce4e0d1ce3f0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f41d872-46ca-455f-ac13-85b6ef40482a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260]
Nov 10 23:03:42 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260] successful.
Nov 10 23:03:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ba5cf9-d52f-4cd0-ac22-696ed0633fd8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7aa02e-7da4-4a30-8d46-0305894850e7]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:03:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:42 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:03:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b15c7d-8892-43bf-b83b-5ef51d9926ed]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snHkXpoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23434383265646266', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434383265646266', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 67ca352f-960d-44d9-9862-06102cfb029b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 23:03:43 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:03:43 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 23:03:43 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:03:43 user nova-compute[75288]:   <serial>2da91226-7c43-4330-b3b6-a9194c91e823</serial>
Nov 10 23:03:43 user nova-compute[75288]: </disk>
Nov 10 23:03:43 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing instance network info cache due to event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:03:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:03:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8232MB free_disk=24.967674255371094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No VIF found with MAC fa:16:3e:9a:70:51, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f1959b81-d8a2-451f-bd21-7dafe2ba297a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 67ca352f-960d-44d9-9862-06102cfb029b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 73b43004-5b50-4f05-a082-d59af20b6496 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d1d2f32-729b-4fa0-a3ab-7e7c7486c547 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.504s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:44 user nova-compute[75288]: INFO nova.compute.manager [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Rebooting instance
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updated VIF entry in instance network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-699d8e10-dbab-434c-acc1-12e154aa8ade req-bc43a344-8650-444a-a8c9-2237850f0d5e service nova] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:44 user nova-compute[75288]: DEBUG nova.network.neutron [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:03:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:03:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "f96f4cb5-d137-4367-b3a5-49adef05247f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:03:47 user nova-compute[75288]: INFO nova.compute.claims [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Claim successful on node user
Nov 10 23:03:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-f5adff98-bdea-47b8-ab56-20a77a5cd4fc req-2dddb94a-3a06-4d0c-a794-7b13b6384d36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f5adff98-bdea-47b8-ab56-20a77a5cd4fc req-2dddb94a-3a06-4d0c-a794-7b13b6384d36 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f5adff98-bdea-47b8-ab56-20a77a5cd4fc req-2dddb94a-3a06-4d0c-a794-7b13b6384d36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f5adff98-bdea-47b8-ab56-20a77a5cd4fc req-2dddb94a-3a06-4d0c-a794-7b13b6384d36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-f5adff98-bdea-47b8-ab56-20a77a5cd4fc req-2dddb94a-3a06-4d0c-a794-7b13b6384d36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:47 user nova-compute[75288]: WARNING nova.compute.manager [req-f5adff98-bdea-47b8-ab56-20a77a5cd4fc req-2dddb94a-3a06-4d0c-a794-7b13b6384d36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state active and task_state reboot_started.
Nov 10 23:03:47 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:03:47 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:03:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.policy [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fd540ceafe84c2b877de1d038b28b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e470a0a6d2f74fad84a1f1f738e8383d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:03:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Creating image(s)
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "/opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance shutdown successfully.
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk 1073741824" returned: 0 in 0.047s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.166s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:03:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Cannot resize image /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Ensure instance console log exists: /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Successfully created port: 24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Successfully updated port: 24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquired lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-1dd7bbc1-aaf5-42c6-bf62-8558ea7cbe54 req-03bcb6e1-20d8-42c3-b4ea-c096fbfd1529 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1dd7bbc1-aaf5-42c6-bf62-8558ea7cbe54 req-03bcb6e1-20d8-42c3-b4ea-c096fbfd1529 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1dd7bbc1-aaf5-42c6-bf62-8558ea7cbe54 req-03bcb6e1-20d8-42c3-b4ea-c096fbfd1529 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1dd7bbc1-aaf5-42c6-bf62-8558ea7cbe54 req-03bcb6e1-20d8-42c3-b4ea-c096fbfd1529 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-1dd7bbc1-aaf5-42c6-bf62-8558ea7cbe54 req-03bcb6e1-20d8-42c3-b4ea-c096fbfd1529 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:49 user nova-compute[75288]: WARNING nova.compute.manager [req-1dd7bbc1-aaf5-42c6-bf62-8558ea7cbe54 req-03bcb6e1-20d8-42c3-b4ea-c096fbfd1529 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state active and task_state reboot_started.
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received event network-changed-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Refreshing instance network info cache due to event network-changed-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] Acquiring lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Updating instance_info_cache with network_info: [{"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Releasing lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Instance network_info: |[{"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] Acquired lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Refreshing network info cache for port 24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Start _get_guest_xml network_info=[{"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:03:50 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:03:50 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1131562101',display_name='tempest-AttachVolumeNegativeTest-server-1131562101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1131562101',id=42,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnjNTCYEA0D3FNcuQ2NLbvaFbZuvIVwTb3zA0e2KEBhEoFTxiaXEfULfPRux+dyNbH66vhmGm+I00xqis/bJP+hw+x1KTA0ilXTjpnNX+35ppodaH3eZIFyzVX8ifz2kA==',key_name='tempest-keypair-1547716025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-66xko0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=f96f4cb5-d137-4367-b3a5-49adef05247f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=24bf31df-17ea-42e8-ba72-d0b0ecf8f16e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24bf31df-17') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'pci_devices' on Instance uuid f96f4cb5-d137-4367-b3a5-49adef05247f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:03:50 user nova-compute[75288]:   <uuid>f96f4cb5-d137-4367-b3a5-49adef05247f</uuid>
Nov 10 23:03:50 user nova-compute[75288]:   <name>instance-0000002a</name>
Nov 10 23:03:50 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:03:50 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:03:50 user nova-compute[75288]:   <metadata>
Nov 10 23:03:50 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:03:50 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:03:50 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1131562101</nova:name>
Nov 10 23:03:50 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:03:50</nova:creationTime>
Nov 10 23:03:50 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:03:50 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:03:50 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:03:50 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:03:50 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:03:50 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:03:50 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:03:50 user nova-compute[75288]:       <nova:owner>
Nov 10 23:03:50 user nova-compute[75288]:         <nova:user uuid="7fd540ceafe84c2b877de1d038b28b73">tempest-AttachVolumeNegativeTest-239737587-project-member</nova:user>
Nov 10 23:03:50 user nova-compute[75288]:         <nova:project uuid="e470a0a6d2f74fad84a1f1f738e8383d">tempest-AttachVolumeNegativeTest-239737587</nova:project>
Nov 10 23:03:50 user nova-compute[75288]:       </nova:owner>
Nov 10 23:03:50 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 23:03:50 user nova-compute[75288]:       <nova:ports>
Nov 10 23:03:50 user nova-compute[75288]:         <nova:port uuid="24bf31df-17ea-42e8-ba72-d0b0ecf8f16e">
Nov 10 23:03:50 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 23:03:50 user nova-compute[75288]:         </nova:port>
Nov 10 23:03:50 user nova-compute[75288]:       </nova:ports>
Nov 10 23:03:50 user nova-compute[75288]:     </nova:instance>
Nov 10 23:03:50 user nova-compute[75288]:   </metadata>
Nov 10 23:03:50 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:03:50 user nova-compute[75288]:     <system>
Nov 10 23:03:50 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:03:50 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:03:50 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:03:50 user nova-compute[75288]:       <entry name="serial">f96f4cb5-d137-4367-b3a5-49adef05247f</entry>
Nov 10 23:03:50 user nova-compute[75288]:       <entry name="uuid">f96f4cb5-d137-4367-b3a5-49adef05247f</entry>
Nov 10 23:03:50 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:03:50 user nova-compute[75288]:     </system>
Nov 10 23:03:50 user nova-compute[75288]:   </sysinfo>
Nov 10 23:03:50 user nova-compute[75288]:   <os>
Nov 10 23:03:50 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:03:50 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:03:50 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:03:50 user nova-compute[75288]:   </os>
Nov 10 23:03:50 user nova-compute[75288]:   <features>
Nov 10 23:03:50 user nova-compute[75288]:     <acpi/>
Nov 10 23:03:50 user nova-compute[75288]:     <apic/>
Nov 10 23:03:50 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:03:50 user nova-compute[75288]:   </features>
Nov 10 23:03:50 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:03:50 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:03:50 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:03:50 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:03:50 user nova-compute[75288]:   </clock>
Nov 10 23:03:50 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:03:50 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:03:50 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:03:50 user nova-compute[75288]:   </cpu>
Nov 10 23:03:50 user nova-compute[75288]:   <devices>
Nov 10 23:03:50 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:03:50 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:03:50 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk"/>
Nov 10 23:03:50 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:03:50 user nova-compute[75288]:     </disk>
Nov 10 23:03:50 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:03:50 user nova-compute[75288]:       <mac address="fa:16:3e:aa:c3:78"/>
Nov 10 23:03:50 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:03:50 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:03:50 user nova-compute[75288]:       <target dev="tap24bf31df-17"/>
Nov 10 23:03:50 user nova-compute[75288]:     </interface>
Nov 10 23:03:50 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:03:50 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/console.log" append="off"/>
Nov 10 23:03:50 user nova-compute[75288]:     </serial>
Nov 10 23:03:50 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:03:50 user nova-compute[75288]:     <video>
Nov 10 23:03:50 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:03:50 user nova-compute[75288]:     </video>
Nov 10 23:03:50 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:03:50 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:03:50 user nova-compute[75288]:     </rng>
Nov 10 23:03:50 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:03:50 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:03:50 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:03:50 user nova-compute[75288]:     </memballoon>
Nov 10 23:03:50 user nova-compute[75288]:   </devices>
Nov 10 23:03:50 user nova-compute[75288]: </domain>
Nov 10 23:03:50 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1131562101',display_name='tempest-AttachVolumeNegativeTest-server-1131562101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1131562101',id=42,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnjNTCYEA0D3FNcuQ2NLbvaFbZuvIVwTb3zA0e2KEBhEoFTxiaXEfULfPRux+dyNbH66vhmGm+I00xqis/bJP+hw+x1KTA0ilXTjpnNX+35ppodaH3eZIFyzVX8ifz2kA==',key_name='tempest-keypair-1547716025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-66xko0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=f96f4cb5-d137-4367-b3a5-49adef05247f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=24bf31df-17ea-42e8-ba72-d0b0ecf8f16e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24bf31df-17') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG os_vif [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=24bf31df-17ea-42e8-ba72-d0b0ecf8f16e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24bf31df-17') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92c8b163-b6d9-566e-9c9f-d54ad5ce2481', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24bf31df-17, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24bf31df-17, col_values=(('qos', UUID('0160cdd2-ad1d-4ccd-bdaa-69fb6a6f896f')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24bf31df-17, col_values=(('external_ids', {'iface-id': '24bf31df-17ea-42e8-ba72-d0b0ecf8f16e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:c3:78', 'vm-uuid': 'f96f4cb5-d137-4367-b3a5-49adef05247f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:50 user nova-compute[75288]: INFO os_vif [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=24bf31df-17ea-42e8-ba72-d0b0ecf8f16e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24bf31df-17')
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No VIF found with MAC fa:16:3e:aa:c3:78, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Updated VIF entry in instance network info cache for port 24bf31df-17ea-42e8-ba72-d0b0ecf8f16e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Updating instance_info_cache with network_info: [{"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-03549093-f74d-4a0f-8aef-8dd77398ffdb req-8b4ea8d1-28dd-4166-8e79-d719cf1ef74c service nova] Releasing lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing instance network info cache due to event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:51 user nova-compute[75288]: WARNING nova.compute.manager [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state active and task_state reboot_started.
Nov 10 23:03:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:51 user nova-compute[75288]: WARNING nova.compute.manager [req-c23a5149-f411-4dfd-a38b-663638b1cb97 req-6aed2aa5-b6a0-4060-9eee-c7eae3f627f1 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state active and task_state reboot_started.
Nov 10 23:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance running successfully.
Nov 10 23:03:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance soft rebooted successfully.
Nov 10 23:03:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-01788590-cb61-4d0e-86b4-ccbccbbde1ce tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.673s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-f73ba892-bae0-4666-b2a8-a0beda1c971a req-f9a35aa1-60f8-4537-9ac9-fd2cd07896ba service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received event network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f73ba892-bae0-4666-b2a8-a0beda1c971a req-f9a35aa1-60f8-4537-9ac9-fd2cd07896ba service nova] Acquiring lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f73ba892-bae0-4666-b2a8-a0beda1c971a req-f9a35aa1-60f8-4537-9ac9-fd2cd07896ba service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f73ba892-bae0-4666-b2a8-a0beda1c971a req-f9a35aa1-60f8-4537-9ac9-fd2cd07896ba service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-f73ba892-bae0-4666-b2a8-a0beda1c971a req-f9a35aa1-60f8-4537-9ac9-fd2cd07896ba service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] No waiting events found dispatching network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:52 user nova-compute[75288]: WARNING nova.compute.manager [req-f73ba892-bae0-4666-b2a8-a0beda1c971a req-f9a35aa1-60f8-4537-9ac9-fd2cd07896ba service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received unexpected event network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e for instance with vm_state building and task_state spawning.
Nov 10 23:03:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:52 user nova-compute[75288]: INFO nova.compute.manager [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Shelve offloading
Nov 10 23:03:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updated VIF entry in instance network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53e32386-d4c4-4562-b3bf-570d6451e5d4 req-64115a76-95fb-499e-be5c-ff3307fc37ae service nova] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance destroyed successfully.
Nov 10 23:03:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-unplugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-unplugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:53 user nova-compute[75288]: WARNING nova.compute.manager [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received unexpected event network-vif-unplugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with vm_state active and task_state shelving.
Nov 10 23:03:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:53 user nova-compute[75288]: WARNING nova.compute.manager [req-f341559c-94dc-4a3d-9b31-1cc5e2403342 req-2525aab3-45b5-4637-af01-91a3c9b72eee service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received unexpected event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with vm_state active and task_state shelving.
Nov 10 23:03:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-edf6566c-e17d-40a7-91dd-633ef7aee58f req-351fa626-e1e7-4a82-92a6-7f5321e02020 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received event network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-edf6566c-e17d-40a7-91dd-633ef7aee58f req-351fa626-e1e7-4a82-92a6-7f5321e02020 service nova] Acquiring lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-edf6566c-e17d-40a7-91dd-633ef7aee58f req-351fa626-e1e7-4a82-92a6-7f5321e02020 service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-edf6566c-e17d-40a7-91dd-633ef7aee58f req-351fa626-e1e7-4a82-92a6-7f5321e02020 service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-edf6566c-e17d-40a7-91dd-633ef7aee58f req-351fa626-e1e7-4a82-92a6-7f5321e02020 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] No waiting events found dispatching network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:03:54 user nova-compute[75288]: WARNING nova.compute.manager [req-edf6566c-e17d-40a7-91dd-633ef7aee58f req-351fa626-e1e7-4a82-92a6-7f5321e02020 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received unexpected event network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e for instance with vm_state building and task_state spawning.
Nov 10 23:03:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance destroyed successfully.
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'resources' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960437778',display_name='tempest-TestShelveInstance-server-1960437778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960437778',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmHVhExr7lbPtKRyZtoqtSU9E8RUajl8Qyppo53C1XB8xNneYgr6uru5V34zaHL25eMCX0WUN3DkjLNm5CAe5hSb3SM0bmE0S1nZrMWaacHmic/leLzCjMKETJErw30lA==',key_name='tempest-TestShelveInstance-851294927',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4405c403b8e4365975b2b3a885c5146',ramdisk_id='',reservation_id='r-hw7cn7zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872213000',owner_user_name='tempest-TestShelveInstance-872213000-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:02:31Z,user_data=None,user_id='09d92fe49e244ab1a8d44d44e350dc51',uuid=73b43004-5b50-4f05-a082-d59af20b6496,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converting VIF {"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_vif [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape66bcde8-1a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=118d5fbc-35fb-4481-9639-3b347076b99b) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:54 user nova-compute[75288]: INFO os_vif [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a')
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:03:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ba8a20-4ba3-4b2c-b442-cb06e6851e30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:03:54 user nova-compute[75288]: No targets found.
Nov 10 23:03:54 user nova-compute[75288]: iSNS:
Nov 10 23:03:54 user nova-compute[75288]: No targets found.
Nov 10 23:03:54 user nova-compute[75288]: STATIC:
Nov 10 23:03:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae
Nov 10 23:03:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:03:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:03:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a
Nov 10 23:03:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:03:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:03:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823
Nov 10 23:03:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:03:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:03:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3
Nov 10 23:03:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:03:54 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:03:54 user nova-compute[75288]: FIRMWARE:
Nov 10 23:03:54 user nova-compute[75288]: No targets found.
Nov 10 23:03:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:03:54 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:03:54 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[302d3fb9-5800-480a-90bd-2a1b7dfbf4ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b119f-da59-445d-ae07-8b48574dda71]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:54 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:54 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:54 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:03:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:03:54 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:03:54 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:03:54 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:03:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10348670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:03:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Instance spawned successfully.
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd6681-1e77-4abc-a05b-a6852c904de7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a56316-970c-404d-9116-c41bebe6d841]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af18b48-3ae8-4ab9-92a1-1b55d065d813]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbe875-7485-47cc-9041-33b77d5baebd]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d2724c-a98c-4aef-8568-699807ed6a4c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: INFO nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ed792-f330-4775-94f6-3e8543fca013]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]
Nov 10 23:03:54 user nova-compute[75288]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.
Nov 10 23:03:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf35888-c3d1-4068-9469-1c8ca2320e01]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] <== disconnect_volume: return (369ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:03:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:03:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Deleting instance files /opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496_del
Nov 10 23:03:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Deletion of /opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496_del complete
Nov 10 23:03:54 user nova-compute[75288]: INFO nova.compute.manager [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Took 7.39 seconds to build instance.
Nov 10 23:03:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ce85dd43-bdb2-43ea-bca9-9765158e59c5 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.497s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:56 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Deleted allocations for instance 73b43004-5b50-4f05-a082-d59af20b6496
Nov 10 23:03:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing instance network info cache due to event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'numa_topology' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG nova.objects.base [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Object Instance<73b43004-5b50-4f05-a082-d59af20b6496> lazy-loaded attributes: resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2d88db-4ac3-40b1-a6d2-79b4a8e26421 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.541s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:03:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updated VIF entry in instance network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:03:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": null, "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape66bcde8-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:03:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-50b968e8-afb3-4ca0-9543-788242e8f332 req-79086904-7dcd-4b8a-82f8-bd4bfd5ddd55 service nova] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:03:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:03:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:04:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:04:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:04:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:04:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:04:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:04:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:04:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:04:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:04:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:04:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:04:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:04:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:04:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:04:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:04:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8212MB free_disk=24.927871704101562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f1959b81-d8a2-451f-bd21-7dafe2ba297a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 67ca352f-960d-44d9-9862-06102cfb029b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance f96f4cb5-d137-4367-b3a5-49adef05247f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing instance network info cache due to event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updated VIF entry in instance network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:04:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a4b5a31e-7071-43bf-8b99-3d5ae2e5be9f req-6a0d6f02-ec94-4a75-8f75-b37800a11ee6 service nova] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:04:45 user nova-compute[75288]: INFO nova.compute.manager [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Detaching volume 3097c7ce-d7e3-4033-9c00-0c00a69867f3
Nov 10 23:04:45 user nova-compute[75288]: INFO nova.virt.block_device [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Attempting to driver detach volume 3097c7ce-d7e3-4033-9c00-0c00a69867f3 from mountpoint /dev/vdb
Nov 10 23:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Attempting to detach device vdb from instance f1959b81-d8a2-451f-bd21-7dafe2ba297a from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 23:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:04:45 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:04:45 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 23:04:45 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:04:45 user nova-compute[75288]:   <serial>3097c7ce-d7e3-4033-9c00-0c00a69867f3</serial>
Nov 10 23:04:45 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:04:45 user nova-compute[75288]: </disk>
Nov 10 23:04:45 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:04:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully detached device vdb from instance f1959b81-d8a2-451f-bd21-7dafe2ba297a from the persistent domain config.
Nov 10 23:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1959b81-d8a2-451f-bd21-7dafe2ba297a from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 23:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:04:45 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:04:45 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 23:04:45 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:04:45 user nova-compute[75288]:   <serial>3097c7ce-d7e3-4033-9c00-0c00a69867f3</serial>
Nov 10 23:04:45 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:04:45 user nova-compute[75288]: </disk>
Nov 10 23:04:45 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing instance network info cache due to event network-changed-57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] Acquiring lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] Acquired lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.network.neutron [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Refreshing network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updating instance_info_cache with network_info: [{"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-67ca352f-960d-44d9-9862-06102cfb029b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.network.neutron [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updated VIF entry in instance network info cache for port 57da2b99-5561-4036-b2d0-c14f906c792c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG nova.network.neutron [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [{"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-23c11c26-98f0-493a-adb2-656ddd1fa859 req-e0ad5cf6-e577-4bda-9369-fbe41adb427e service nova] Releasing lock "refresh_cache-f1959b81-d8a2-451f-bd21-7dafe2ba297a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:04:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:50 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:50 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:04:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:04:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:04:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:05 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1959b81-d8a2-451f-bd21-7dafe2ba297a is timed out.
Nov 10 23:05:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully detached device vdb from instance f1959b81-d8a2-451f-bd21-7dafe2ba297a from the live domain config.
Nov 10 23:05:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ecduntjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:05:05 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c277b0-9025-4809-a1d1-39694adc6265]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:05:05 user nova-compute[75288]: No targets found.
Nov 10 23:05:05 user nova-compute[75288]: iSNS:
Nov 10 23:05:05 user nova-compute[75288]: No targets found.
Nov 10 23:05:05 user nova-compute[75288]: STATIC:
Nov 10 23:05:05 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a
Nov 10 23:05:05 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:05:05 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:05:05 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823
Nov 10 23:05:05 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:05:05 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:05:05 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3
Nov 10 23:05:05 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:05:05 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:05:05 user nova-compute[75288]: FIRMWARE:
Nov 10 23:05:05 user nova-compute[75288]: No targets found.
Nov 10 23:05:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:05:05 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:05:05 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16fdbc8-0c38-4f4d-ae5c-47288e6d9862]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[45982c21-7fab-4f34-b66c-c1c54c0189cd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:05:05 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:05:05 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:05:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 (non-flash)
Nov 10 23:05:05 user nova-compute[75288]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:05:05 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:05:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b283e0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a1d3e7-6c49-4e38-b6dc-5ad3462842dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a622066b-5480-4210-87e0-260dad421ca8]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c0e882-2f7c-4ef1-9882-099ea9922fbe]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea78a71e-321e-4f38-8ed0-2859d2178c9a]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ba1938-3a23-405c-a33f-d84e997559fd]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07d59bc-cec7-4d4a-a581-bdd4eb5cf920]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260]
Nov 10 23:05:05 user nova-compute[75288]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3, portal: 172.16.0.220,3260] successful.
Nov 10 23:05:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3097c7ce-d7e3-4033-9c00-0c00a69867f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f46d9db-960e-4153-99b5-a238914733e9]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] <== disconnect_volume: return (333ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:05:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:05:07 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'flavor' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c3a438c-2b0a-4e3d-9ca6-874cc569ec9d tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.161s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:05:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:05:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:05:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:05:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:05:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:05:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:05:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:05:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:05:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:35 user nova-compute[75288]: INFO nova.compute.manager [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Terminating instance
Nov 10 23:05:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-9cdf6766-1c80-4a19-b4f5-7dc24ddde001 req-b5cf7a5f-4837-4319-81b8-04451c0b83c4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9cdf6766-1c80-4a19-b4f5-7dc24ddde001 req-b5cf7a5f-4837-4319-81b8-04451c0b83c4 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9cdf6766-1c80-4a19-b4f5-7dc24ddde001 req-b5cf7a5f-4837-4319-81b8-04451c0b83c4 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9cdf6766-1c80-4a19-b4f5-7dc24ddde001 req-b5cf7a5f-4837-4319-81b8-04451c0b83c4 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-9cdf6766-1c80-4a19-b4f5-7dc24ddde001 req-b5cf7a5f-4837-4319-81b8-04451c0b83c4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-9cdf6766-1c80-4a19-b4f5-7dc24ddde001 req-b5cf7a5f-4837-4319-81b8-04451c0b83c4 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-unplugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Instance destroyed successfully.
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'resources' on Instance uuid f1959b81-d8a2-451f-bd21-7dafe2ba297a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:58:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-215007874',display_name='tempest-ServerRescueNegativeTestJSON-server-215007874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-215007874',id=38,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDSC9a4Smj3mI6m3JcoREpzwGvJIoyNYgQEOB8JKXAk2RjbBuKOKfCSWhULK01Om31hJKxMNHTnkH/sIKWuNAqhmwp/MhQ6ymktOB+Raer772w07tJPebhMOl3XVlxt6Q==',key_name='tempest-keypair-1928965267',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-xx1qth9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=f1959b81-d8a2-451f-bd21-7dafe2ba297a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "57da2b99-5561-4036-b2d0-c14f906c792c", "address": "fa:16:3e:a0:db:0e", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57da2b99-55", "ovs_interfaceid": "57da2b99-5561-4036-b2d0-c14f906c792c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG os_vif [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57da2b99-55, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd318f6c-40e5-4eab-82d6-6d0ddee236be) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:36 user nova-compute[75288]: INFO os_vif [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:db:0e,bridge_name='br-int',has_traffic_filtering=True,id=57da2b99-5561-4036-b2d0-c14f906c792c,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57da2b99-55')
Nov 10 23:05:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Deleting instance files /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a_del
Nov 10 23:05:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Deletion of /opt/stack/data/nova/instances/f1959b81-d8a2-451f-bd21-7dafe2ba297a_del complete
Nov 10 23:05:36 user nova-compute[75288]: INFO nova.compute.manager [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 23:05:36 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing instance network info cache due to event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:05:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:05:37 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Took 0.79 seconds to deallocate network for instance.
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-3596f758-5626-4314-ac79-187af6dae373 req-a261df01-560b-4a77-a9da-1a2eb26f10fe service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-deleted-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updated VIF entry in instance network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1099abe1-ead0-409d-a368-b72c3268707b req-3b774f9a-d0e8-498b-b606-1485e4af79c9 service nova] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:37 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Deleted allocations for instance f1959b81-d8a2-451f-bd21-7dafe2ba297a
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-30ba57e6-4b09-449f-93a6-c492411c9fd4 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-55634db8-ba25-4cb0-bea8-c337438e0e84 req-09cec362-3492-46b4-bb65-af76267c4035 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-55634db8-ba25-4cb0-bea8-c337438e0e84 req-09cec362-3492-46b4-bb65-af76267c4035 service nova] Acquiring lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-55634db8-ba25-4cb0-bea8-c337438e0e84 req-09cec362-3492-46b4-bb65-af76267c4035 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-55634db8-ba25-4cb0-bea8-c337438e0e84 req-09cec362-3492-46b4-bb65-af76267c4035 service nova] Lock "f1959b81-d8a2-451f-bd21-7dafe2ba297a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-55634db8-ba25-4cb0-bea8-c337438e0e84 req-09cec362-3492-46b4-bb65-af76267c4035 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] No waiting events found dispatching network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:05:37 user nova-compute[75288]: WARNING nova.compute.manager [req-55634db8-ba25-4cb0-bea8-c337438e0e84 req-09cec362-3492-46b4-bb65-af76267c4035 service nova] [instance: f1959b81-d8a2-451f-bd21-7dafe2ba297a] Received unexpected event network-vif-plugged-57da2b99-5561-4036-b2d0-c14f906c792c for instance with vm_state deleted and task_state None.
Nov 10 23:05:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:38 user nova-compute[75288]: INFO nova.compute.manager [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Detaching volume 8da5a310-0f29-4da2-a61e-6024a0bfe45a
Nov 10 23:05:38 user nova-compute[75288]: INFO nova.virt.block_device [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Attempting to driver detach volume 8da5a310-0f29-4da2-a61e-6024a0bfe45a from mountpoint /dev/vdb
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Attempting to detach device vdb from instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:05:38 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:05:38 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 23:05:38 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:05:38 user nova-compute[75288]:   <serial>8da5a310-0f29-4da2-a61e-6024a0bfe45a</serial>
Nov 10 23:05:38 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:05:38 user nova-compute[75288]: </disk>
Nov 10 23:05:38 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:05:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully detached device vdb from instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 from the persistent domain config.
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:05:38 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:05:38 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Nov 10 23:05:38 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:05:38 user nova-compute[75288]:   <serial>8da5a310-0f29-4da2-a61e-6024a0bfe45a</serial>
Nov 10 23:05:38 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:05:38 user nova-compute[75288]: </disk>
Nov 10 23:05:38 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received event network-changed-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Refreshing instance network info cache due to event network-changed-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] Acquiring lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] Acquired lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:05:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Refreshing network info cache for port 24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing instance network info cache due to event network-changed-f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Refreshing network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Updated VIF entry in instance network info cache for port 24bf31df-17ea-42e8-ba72-d0b0ecf8f16e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Updating instance_info_cache with network_info: [{"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf546684-a4b2-4fec-8cf3-ceebd082acc1 req-28df6ee5-4d16-4558-b66f-891a07deff80 service nova] Releasing lock "refresh_cache-f96f4cb5-d137-4367-b3a5-49adef05247f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "f96f4cb5-d137-4367-b3a5-49adef05247f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:39 user nova-compute[75288]: INFO nova.compute.manager [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Terminating instance
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updated VIF entry in instance network info cache for port f26f08ec-0757-4da3-8f06-2cf07dadbbcf. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6567f0b0-3661-4891-8bec-c59d0573b215 req-5c730b42-6d7d-460d-bbb6-6d9bbddf4e75 service nova] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Instance destroyed successfully.
Nov 10 23:05:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'resources' on Instance uuid f96f4cb5-d137-4367-b3a5-49adef05247f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1131562101',display_name='tempest-AttachVolumeNegativeTest-server-1131562101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1131562101',id=42,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnjNTCYEA0D3FNcuQ2NLbvaFbZuvIVwTb3zA0e2KEBhEoFTxiaXEfULfPRux+dyNbH66vhmGm+I00xqis/bJP+hw+x1KTA0ilXTjpnNX+35ppodaH3eZIFyzVX8ifz2kA==',key_name='tempest-keypair-1547716025',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-66xko0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=f96f4cb5-d137-4367-b3a5-49adef05247f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "address": "fa:16:3e:aa:c3:78", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24bf31df-17", "ovs_interfaceid": "24bf31df-17ea-42e8-ba72-d0b0ecf8f16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=24bf31df-17ea-42e8-ba72-d0b0ecf8f16e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24bf31df-17') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG os_vif [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=24bf31df-17ea-42e8-ba72-d0b0ecf8f16e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24bf31df-17') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24bf31df-17, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0160cdd2-ad1d-4ccd-bdaa-69fb6a6f896f) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:40 user nova-compute[75288]: INFO os_vif [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c3:78,bridge_name='br-int',has_traffic_filtering=True,id=24bf31df-17ea-42e8-ba72-d0b0ecf8f16e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24bf31df-17')
Nov 10 23:05:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Deleting instance files /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f_del
Nov 10 23:05:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Deletion of /opt/stack/data/nova/instances/f96f4cb5-d137-4367-b3a5-49adef05247f_del complete
Nov 10 23:05:40 user nova-compute[75288]: INFO nova.compute.manager [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:05:40 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Took 0.69 seconds to deallocate network for instance.
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received event network-vif-unplugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] Acquiring lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] No waiting events found dispatching network-vif-unplugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:05:40 user nova-compute[75288]: WARNING nova.compute.manager [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received unexpected event network-vif-unplugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e for instance with vm_state deleted and task_state None.
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received event network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] Acquiring lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] No waiting events found dispatching network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:05:40 user nova-compute[75288]: WARNING nova.compute.manager [req-5bafe558-052a-4640-9514-7adb7f710a07 req-2e5f1d37-3822-4355-bb12-171496128fbd service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received unexpected event network-vif-plugged-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e for instance with vm_state deleted and task_state None.
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-71f646e9-08e4-4e93-aaf4-b5b15ee156cf req-d0ddcbb2-57e5-4102-8dc7-fc9745a71514 service nova] [instance: f96f4cb5-d137-4367-b3a5-49adef05247f] Received event network-vif-deleted-24bf31df-17ea-42e8-ba72-d0b0ecf8f16e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:41 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Deleted allocations for instance f96f4cb5-d137-4367-b3a5-49adef05247f
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ad2ac56-0843-4ba3-abc1-43fc3d347d4c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f96f4cb5-d137-4367-b3a5-49adef05247f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:05:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8525MB free_disk=24.982166290283203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 67ca352f-960d-44d9-9862-06102cfb029b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:05:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:05:44 user nova-compute[75288]: INFO nova.compute.manager [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Unshelving
Nov 10 23:05:44 user nova-compute[75288]: INFO nova.virt.block_device [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Booting with volume b1276ebc-9789-44a6-bad2-122e46529aae at /dev/vda
Nov 10 23:05:44 user nova-compute[75288]: DEBUG os_brick.utils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1728484b-0f66-4d26-a274-a3c717c98cc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc2672f-a90f-4698-b211-eb974c0a3fdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f32481c-0eef-4170-adcc-60d37dce9fdb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98d9d7c-396f-4a4b-a855-7bc4c4919e82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:05:44 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:05:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a4eefa-dff1-4ed8-8076-f7e600f9b581]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG os_brick.utils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:05:44 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating existing volume attachment record: 12557fb5-8200-418c-9474-f8c58f0ff545 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:05:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [{"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-45ef67d8-4ef2-4481-85e2-fa12d115fe60" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:05:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:05:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 23:05:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:05:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 is timed out.
Nov 10 23:05:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully detached device vdb from instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 from the live domain config.
Nov 10 23:05:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnsVrRpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:05:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41a5ab8-833c-495e-9c96-b7c1bbb94c5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e989823-7cb2-470c-9cf7-500d1af27600\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78fb1300-4ecf-42ff-a96d-ea54e274556f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:05:58 user nova-compute[75288]: No targets found.
Nov 10 23:05:58 user nova-compute[75288]: iSNS:
Nov 10 23:05:58 user nova-compute[75288]: No targets found.
Nov 10 23:05:58 user nova-compute[75288]: STATIC:
Nov 10 23:05:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6e989823-7cb2-470c-9cf7-500d1af27600
Nov 10 23:05:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:05:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:05:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a
Nov 10 23:05:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:05:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:05:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823
Nov 10 23:05:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:05:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:05:58 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:78fb1300-4ecf-42ff-a96d-ea54e274556f
Nov 10 23:05:58 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:05:58 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:05:58 user nova-compute[75288]: FIRMWARE:
Nov 10 23:05:58 user nova-compute[75288]: No targets found.
Nov 10 23:05:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:05:58 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:05:58 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e35b487-c998-46c1-9f75-647b46e42046]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e989823-7cb2-470c-9cf7-500d1af27600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78fb1300-4ecf-42ff-a96d-ea54e274556f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a144df3-4d12-4402-b6ed-95410655af46]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78fb1300-4ecf-42ff-a96d-ea54e274556f (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:05:58 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:05:58 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78fb1300-4ecf-42ff-a96d-ea54e274556f (non-flash)
Nov 10 23:05:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a (non-flash)
Nov 10 23:05:58 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:05:58 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78fb1300-4ecf-42ff-a96d-ea54e274556f (non-flash)
Nov 10 23:05:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b103385e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca6594f-e8b7-4d5b-8d8d-6cbac1387fa0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac1b27-8f90-4622-9ea7-2e0d96b859b9]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d0b91-cbce-431d-997b-f51f6e431bd7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9409aad-ac91-4438-9ae9-23066ecf382e]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d7c77-d69c-4ab8-97a8-56b70bcc863c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[076caedc-698c-427c-be57-699ffa137af3]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260]
Nov 10 23:05:58 user nova-compute[75288]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a, portal: 172.16.0.220,3260] successful.
Nov 10 23:05:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8da5a310-0f29-4da2-a61e-6024a0bfe45a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b3844-c6a0-486b-a88d-5202496cdf25]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] <== disconnect_volume: return (322ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:05:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:05:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'flavor' on Instance uuid 45ef67d8-4ef2-4481-85e2-fa12d115fe60 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:05:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1a51e6d-fd1d-40d1-ac0e-ebd09ab80322 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.915s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:06:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:06:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'pci_requests' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'numa_topology' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:06:20 user nova-compute[75288]: INFO nova.compute.claims [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Claim successful on node user
Nov 10 23:06:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 23:06:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance has had 4 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 23:06:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Deletion of /opt/stack/data/nova/instances/b9342997-048d-4f4f-a552-de76f2a0a444_resize failed
Nov 10 23:06:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:21 user nova-compute[75288]: INFO nova.network.neutron [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing instance network info cache due to event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:06:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Creating image(s)
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Ensure instance console log exists: /opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Start _get_guest_xml network_info=[{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73b43004-5b50-4f05-a082-d59af20b6496', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1276ebc-9789-44a6-bad2-122e46529aae', 'serial': 'b1276ebc-9789-44a6-bad2-122e46529aae'}, 'mount_device': '/dev/vda', 'attachment_id': '12557fb5-8200-418c-9474-f8c58f0ff545', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:06:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:06:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.objects.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Object Instance<73b43004-5b50-4f05-a082-d59af20b6496> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:06:22 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:06:22 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:06:22 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc68ef9-e935-4bcf-adc0-935a1a809600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:06:22 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f596ebc-31b9-47fd-872d-90a5ece0c092]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae] added
Nov 10 23:06:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9786238d-3954-4ed6-ab89-d276f2e94ae4]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f023ee-25e5-44b0-89ac-a8fcc39d5165]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASpCPGcK {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASpCPGcK" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4250a0-56e3-40b1-9c32-258dabaa5ac7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASpCPGcK'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea772c8-981c-464b-8bc0-8e7473ce2b20]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d471f3e7-225b-495f-ba16-e2f65c2e47ee]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:06:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:06:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[effb42c5-ad58-4ba0-953f-0f2b469a2782]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]
Nov 10 23:06:22 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.
Nov 10 23:06:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f09bda-045a-4de7-9dcf-eca14feb71dc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[24801e50-e296-4939-b40d-906817768b36]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:06:22 user nova-compute[75288]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:06:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:06:22 user nova-compute[75288]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:06:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff8e0b-bd71-4503-b482-91827979dbc2]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updated VIF entry in instance network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1a7be3a-3313-4b72-9d25-646b62790da3 req-159deb77-8f61-4815-9866-8354c9479e41 service nova] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23138393930346466', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138393930346466', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960437778',display_name='tempest-TestShelveInstance-server-1960437778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960437778',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-851294927',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f4405c403b8e4365975b2b3a885c5146',ramdisk_id='',reservation_id='r-hw7cn7zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872213000',owner_user_name='tempest-TestShelveInstance-872213000-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:05:44Z,user_data=None,user_id='09d92fe49e244ab1a8d44d44e350dc51',uuid=73b43004-5b50-4f05-a082-d59af20b6496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converting VIF {"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'pci_devices' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.objects.base [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Object Instance<73b43004-5b50-4f05-a082-d59af20b6496> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:06:23 user nova-compute[75288]:   <uuid>73b43004-5b50-4f05-a082-d59af20b6496</uuid>
Nov 10 23:06:23 user nova-compute[75288]:   <name>instance-00000029</name>
Nov 10 23:06:23 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:06:23 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:06:23 user nova-compute[75288]:   <metadata>
Nov 10 23:06:23 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:06:23 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:06:23 user nova-compute[75288]:       <nova:name>tempest-TestShelveInstance-server-1960437778</nova:name>
Nov 10 23:06:23 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:06:22</nova:creationTime>
Nov 10 23:06:23 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:06:23 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:06:23 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:06:23 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:06:23 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:06:23 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:06:23 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:06:23 user nova-compute[75288]:       <nova:owner>
Nov 10 23:06:23 user nova-compute[75288]:         <nova:user uuid="09d92fe49e244ab1a8d44d44e350dc51">tempest-TestShelveInstance-872213000-project-member</nova:user>
Nov 10 23:06:23 user nova-compute[75288]:         <nova:project uuid="f4405c403b8e4365975b2b3a885c5146">tempest-TestShelveInstance-872213000</nova:project>
Nov 10 23:06:23 user nova-compute[75288]:       </nova:owner>
Nov 10 23:06:23 user nova-compute[75288]:       <nova:ports>
Nov 10 23:06:23 user nova-compute[75288]:         <nova:port uuid="e66bcde8-1a94-4b2b-b7f5-852a754c8f5d">
Nov 10 23:06:23 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 23:06:23 user nova-compute[75288]:         </nova:port>
Nov 10 23:06:23 user nova-compute[75288]:       </nova:ports>
Nov 10 23:06:23 user nova-compute[75288]:     </nova:instance>
Nov 10 23:06:23 user nova-compute[75288]:   </metadata>
Nov 10 23:06:23 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:06:23 user nova-compute[75288]:     <system>
Nov 10 23:06:23 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:06:23 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:06:23 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:06:23 user nova-compute[75288]:       <entry name="serial">73b43004-5b50-4f05-a082-d59af20b6496</entry>
Nov 10 23:06:23 user nova-compute[75288]:       <entry name="uuid">73b43004-5b50-4f05-a082-d59af20b6496</entry>
Nov 10 23:06:23 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:06:23 user nova-compute[75288]:     </system>
Nov 10 23:06:23 user nova-compute[75288]:   </sysinfo>
Nov 10 23:06:23 user nova-compute[75288]:   <os>
Nov 10 23:06:23 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:06:23 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:06:23 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:06:23 user nova-compute[75288]:   </os>
Nov 10 23:06:23 user nova-compute[75288]:   <features>
Nov 10 23:06:23 user nova-compute[75288]:     <acpi/>
Nov 10 23:06:23 user nova-compute[75288]:     <apic/>
Nov 10 23:06:23 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:06:23 user nova-compute[75288]:   </features>
Nov 10 23:06:23 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:06:23 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:06:23 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:06:23 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:06:23 user nova-compute[75288]:   </clock>
Nov 10 23:06:23 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:06:23 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:06:23 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:06:23 user nova-compute[75288]:   </cpu>
Nov 10 23:06:23 user nova-compute[75288]:   <devices>
Nov 10 23:06:23 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 23:06:23 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:06:23 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 23:06:23 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:06:23 user nova-compute[75288]:       <serial>b1276ebc-9789-44a6-bad2-122e46529aae</serial>
Nov 10 23:06:23 user nova-compute[75288]:     </disk>
Nov 10 23:06:23 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:06:23 user nova-compute[75288]:       <mac address="fa:16:3e:3a:1c:b7"/>
Nov 10 23:06:23 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:06:23 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:06:23 user nova-compute[75288]:       <target dev="tape66bcde8-1a"/>
Nov 10 23:06:23 user nova-compute[75288]:     </interface>
Nov 10 23:06:23 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:06:23 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496/console.log" append="off"/>
Nov 10 23:06:23 user nova-compute[75288]:     </serial>
Nov 10 23:06:23 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:06:23 user nova-compute[75288]:     <video>
Nov 10 23:06:23 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:06:23 user nova-compute[75288]:     </video>
Nov 10 23:06:23 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:06:23 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:06:23 user nova-compute[75288]:     </rng>
Nov 10 23:06:23 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:06:23 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:06:23 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:06:23 user nova-compute[75288]:     </memballoon>
Nov 10 23:06:23 user nova-compute[75288]:   </devices>
Nov 10 23:06:23 user nova-compute[75288]: </domain>
Nov 10 23:06:23 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960437778',display_name='tempest-TestShelveInstance-server-1960437778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960437778',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-851294927',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f4405c403b8e4365975b2b3a885c5146',ramdisk_id='',reservation_id='r-hw7cn7zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872213000',owner_user_name='tempest-TestShelveInstance-872213000-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:05:44Z,user_data=None,user_id='09d92fe49e244ab1a8d44d44e350dc51',uuid=73b43004-5b50-4f05-a082-d59af20b6496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converting VIF {"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG os_vif [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90684a06-3de1-579a-a804-104006020540', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape66bcde8-1a, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape66bcde8-1a, col_values=(('qos', UUID('256f607e-dbca-443e-b87a-aefd9f9e91e8')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape66bcde8-1a, col_values=(('external_ids', {'iface-id': 'e66bcde8-1a94-4b2b-b7f5-852a754c8f5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:1c:b7', 'vm-uuid': '73b43004-5b50-4f05-a082-d59af20b6496'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:23 user nova-compute[75288]: INFO os_vif [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a')
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:06:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] No VIF found with MAC fa:16:3e:3a:1c:b7, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-79bb3a99-6ef3-4a74-9723-962ccda207a8 req-17b37d33-b609-48f1-b5d4-048e6b7c9291 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-79bb3a99-6ef3-4a74-9723-962ccda207a8 req-17b37d33-b609-48f1-b5d4-048e6b7c9291 service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-79bb3a99-6ef3-4a74-9723-962ccda207a8 req-17b37d33-b609-48f1-b5d4-048e6b7c9291 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-79bb3a99-6ef3-4a74-9723-962ccda207a8 req-17b37d33-b609-48f1-b5d4-048e6b7c9291 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-79bb3a99-6ef3-4a74-9723-962ccda207a8 req-17b37d33-b609-48f1-b5d4-048e6b7c9291 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:25 user nova-compute[75288]: WARNING nova.compute.manager [req-79bb3a99-6ef3-4a74-9723-962ccda207a8 req-17b37d33-b609-48f1-b5d4-048e6b7c9291 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received unexpected event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 23:06:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-33b05e10-28f9-4564-9d60-5be737c569fc req-2328a670-9bfd-496e-b60f-4480263e5b90 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-33b05e10-28f9-4564-9d60-5be737c569fc req-2328a670-9bfd-496e-b60f-4480263e5b90 service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-33b05e10-28f9-4564-9d60-5be737c569fc req-2328a670-9bfd-496e-b60f-4480263e5b90 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-33b05e10-28f9-4564-9d60-5be737c569fc req-2328a670-9bfd-496e-b60f-4480263e5b90 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-33b05e10-28f9-4564-9d60-5be737c569fc req-2328a670-9bfd-496e-b60f-4480263e5b90 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:27 user nova-compute[75288]: WARNING nova.compute.manager [req-33b05e10-28f9-4564-9d60-5be737c569fc req-2328a670-9bfd-496e-b60f-4480263e5b90 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received unexpected event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 23:06:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:06:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:06:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance spawned successfully.
Nov 10 23:06:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:06:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc36352f-7710-41ec-98a1-fa68ce2de67a tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 43.298s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:31 user nova-compute[75288]: INFO nova.compute.manager [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Detaching volume 2da91226-7c43-4330-b3b6-a9194c91e823
Nov 10 23:06:31 user nova-compute[75288]: INFO nova.virt.block_device [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Attempting to driver detach volume 2da91226-7c43-4330-b3b6-a9194c91e823 from mountpoint /dev/vdb
Nov 10 23:06:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Attempting to detach device vdb from instance 67ca352f-960d-44d9-9862-06102cfb029b from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 23:06:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:06:31 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:06:31 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 23:06:31 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:06:31 user nova-compute[75288]:   <serial>2da91226-7c43-4330-b3b6-a9194c91e823</serial>
Nov 10 23:06:31 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:06:31 user nova-compute[75288]: </disk>
Nov 10 23:06:31 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:06:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully detached device vdb from instance 67ca352f-960d-44d9-9862-06102cfb029b from the persistent domain config.
Nov 10 23:06:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67ca352f-960d-44d9-9862-06102cfb029b from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 23:06:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:06:31 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:06:31 user nova-compute[75288]:   <source dev="/dev/sde"/>
Nov 10 23:06:31 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:06:31 user nova-compute[75288]:   <serial>2da91226-7c43-4330-b3b6-a9194c91e823</serial>
Nov 10 23:06:31 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:06:31 user nova-compute[75288]: </disk>
Nov 10 23:06:31 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:06:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67ca352f-960d-44d9-9862-06102cfb029b {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 23:06:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:06:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:06:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:06:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:06:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=24.97943878173828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance ad132b9c-5de3-4d1a-ab55-4e95d589df45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 67ca352f-960d-44d9-9862-06102cfb029b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 73b43004-5b50-4f05-a082-d59af20b6496 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:06:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:06:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:06:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [{"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:06:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-0c73ba31-10a8-483a-9fcc-fe0beeeffba8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:06:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:06:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:51 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67ca352f-960d-44d9-9862-06102cfb029b is timed out.
Nov 10 23:06:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully detached device vdb from instance 67ca352f-960d-44d9-9862-06102cfb029b from the live domain config.
Nov 10 23:06:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snHkXpoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:06:51 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3e5502-9c6b-4b1c-a979-55f1648e0b90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:06:51 user nova-compute[75288]: No targets found.
Nov 10 23:06:51 user nova-compute[75288]: iSNS:
Nov 10 23:06:51 user nova-compute[75288]: No targets found.
Nov 10 23:06:51 user nova-compute[75288]: STATIC:
Nov 10 23:06:51 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae
Nov 10 23:06:51 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:06:51 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:06:51 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823
Nov 10 23:06:51 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:06:51 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:06:51 user nova-compute[75288]: FIRMWARE:
Nov 10 23:06:51 user nova-compute[75288]: No targets found.
Nov 10 23:06:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:06:51 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:06:51 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368ecfe-b456-45d7-889c-7cf9287a24c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ff4b0a-8a5b-44a3-9ae4-ee3f995d3812]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:06:51 user nova-compute[75288]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:06:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 (non-flash)
Nov 10 23:06:51 user nova-compute[75288]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:06:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b20117b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed9a7c-8642-4815-a1bb-917d90dcdd80]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0777a2-6494-42cf-ab4a-5ac705e01053]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7fbb9e-df89-4bff-873e-ae7e51ede15e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[481a1d03-8337-4830-ba3e-d46c9c896a1f]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f5ded-7f64-4c0e-b809-fa63e27431ab]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[825befa8-6491-4878-a50c-2e4f6c5c9d8c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260]
Nov 10 23:06:52 user nova-compute[75288]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823, portal: 172.16.0.220,3260] successful.
Nov 10 23:06:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2da91226-7c43-4330-b3b6-a9194c91e823 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdb7ef7-edba-4459-9339-baeea19360a1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== disconnect_volume: return (306ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:52 user nova-compute[75288]: INFO nova.compute.manager [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Terminating instance
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-1693ab47-c2b6-4f1a-b790-c7d524fd9097 req-7061022b-ce05-4374-9525-aeb6b0cca60f service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1693ab47-c2b6-4f1a-b790-c7d524fd9097 req-7061022b-ce05-4374-9525-aeb6b0cca60f service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1693ab47-c2b6-4f1a-b790-c7d524fd9097 req-7061022b-ce05-4374-9525-aeb6b0cca60f service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1693ab47-c2b6-4f1a-b790-c7d524fd9097 req-7061022b-ce05-4374-9525-aeb6b0cca60f service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-1693ab47-c2b6-4f1a-b790-c7d524fd9097 req-7061022b-ce05-4374-9525-aeb6b0cca60f service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-1693ab47-c2b6-4f1a-b790-c7d524fd9097 req-7061022b-ce05-4374-9525-aeb6b0cca60f service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Instance destroyed successfully.
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lazy-loading 'resources' on Instance uuid 45ef67d8-4ef2-4481-85e2-fa12d115fe60 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1887113788',display_name='tempest-TestMinimumBasicScenario-server-1887113788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1887113788',id=40,image_ref='3d0b8ec2-174b-4b1a-966c-70c0afd993ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMll2H55Gg3hUsRCAQc3zyK60WPSjdMvp/wfwqvsasG2mToNWc0iQwHv7ZVHFvsDPR2nCpt49hdfvUM7AOX7YZg3KcdQraaMnp6V/XGt5YVdzWfdpaSH2nhtKTqcZsveOA==',key_name='tempest-TestMinimumBasicScenario-1252083279',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:01:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0485db81ce8748b1b2bf3b8e907cdc5a',ramdisk_id='',reservation_id='r-tsfsx3og',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3d0b8ec2-174b-4b1a-966c-70c0afd993ef',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-519527003',owner_user_name='tempest-TestMinimumBasicScenario-519527003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:03:52Z,user_data=None,user_id='f86919732056405e8f8da616270f2672',uuid=45ef67d8-4ef2-4481-85e2-fa12d115fe60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converting VIF {"id": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "address": "fa:16:3e:84:71:08", "network": {"id": "4a9f73d4-b372-45d3-90f3-69485324e75e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1690731490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0485db81ce8748b1b2bf3b8e907cdc5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26f08ec-07", "ovs_interfaceid": "f26f08ec-0757-4da3-8f06-2cf07dadbbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:71:08,bridge_name='br-int',has_traffic_filtering=True,id=f26f08ec-0757-4da3-8f06-2cf07dadbbcf,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26f08ec-07') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG os_vif [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:71:08,bridge_name='br-int',has_traffic_filtering=True,id=f26f08ec-0757-4da3-8f06-2cf07dadbbcf,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26f08ec-07') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf26f08ec-07, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=592bd4cd-76af-48cd-94fc-aff0030ca981) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: INFO os_vif [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:71:08,bridge_name='br-int',has_traffic_filtering=True,id=f26f08ec-0757-4da3-8f06-2cf07dadbbcf,network=Network(4a9f73d4-b372-45d3-90f3-69485324e75e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26f08ec-07')
Nov 10 23:06:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Deleting instance files /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60_del
Nov 10 23:06:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Deletion of /opt/stack/data/nova/instances/45ef67d8-4ef2-4481-85e2-fa12d115fe60_del complete
Nov 10 23:06:53 user nova-compute[75288]: INFO nova.compute.manager [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 10 23:06:53 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:06:53 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Took 0.60 seconds to deallocate network for instance.
Nov 10 23:06:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-a2d0d5c1-a18b-42d3-bf61-06a538ff6914 req-8e2e2ee3-a635-40e7-baa7-de33afbc3034 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-deleted-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:06:53 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:54 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Deleted allocations for instance 45ef67d8-4ef2-4481-85e2-fa12d115fe60
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d57c3d36-a43a-45f2-a7bb-38a8a7e100a6 tempest-TestMinimumBasicScenario-519527003 tempest-TestMinimumBasicScenario-519527003-project-member] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:54 user nova-compute[75288]: WARNING nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state deleted and task_state None.
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:54 user nova-compute[75288]: WARNING nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state deleted and task_state None.
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:54 user nova-compute[75288]: WARNING nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state deleted and task_state None.
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:54 user nova-compute[75288]: WARNING nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-unplugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state deleted and task_state None.
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Acquiring lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] Lock "45ef67d8-4ef2-4481-85e2-fa12d115fe60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:06:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] No waiting events found dispatching network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:06:54 user nova-compute[75288]: WARNING nova.compute.manager [req-6a6713d7-64fa-4a29-a4c4-683cd5943a91 req-dee3572c-a6e7-402e-98c5-0f297e9cfe36 service nova] [instance: 45ef67d8-4ef2-4481-85e2-fa12d115fe60] Received unexpected event network-vif-plugged-f26f08ec-0757-4da3-8f06-2cf07dadbbcf for instance with vm_state deleted and task_state None.
Nov 10 23:06:54 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:06:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:06:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:02 user nova-compute[75288]: INFO nova.compute.manager [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Terminating instance
Nov 10 23:07:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-936bd1dd-f4a0-454a-95b9-107a4f384a76 req-e32a8c07-b31c-42ad-a559-08227d0c0ee2 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-unplugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-936bd1dd-f4a0-454a-95b9-107a4f384a76 req-e32a8c07-b31c-42ad-a559-08227d0c0ee2 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-936bd1dd-f4a0-454a-95b9-107a4f384a76 req-e32a8c07-b31c-42ad-a559-08227d0c0ee2 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-936bd1dd-f4a0-454a-95b9-107a4f384a76 req-e32a8c07-b31c-42ad-a559-08227d0c0ee2 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-936bd1dd-f4a0-454a-95b9-107a4f384a76 req-e32a8c07-b31c-42ad-a559-08227d0c0ee2 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-unplugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-936bd1dd-f4a0-454a-95b9-107a4f384a76 req-e32a8c07-b31c-42ad-a559-08227d0c0ee2 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-unplugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:02 user nova-compute[75288]: DEBUG nova.objects.instance [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 67ca352f-960d-44d9-9862-06102cfb029b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-abcdfcc1-3075-4104-998b-d0c748b74f9f tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.894s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Instance destroyed successfully.
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'resources' on Instance uuid ad132b9c-5de3-4d1a-ab55-4e95d589df45 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-888792900',display_name='tempest-ServerRescueNegativeTestJSON-server-888792900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-888792900',id=29,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-nim7tncv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:51:53Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=ad132b9c-5de3-4d1a-ab55-4e95d589df45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "3b62047c-54d3-41ba-a037-230d76298105", "address": "fa:16:3e:2c:74:f2", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b62047c-54", "ovs_interfaceid": "3b62047c-54d3-41ba-a037-230d76298105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG os_vif [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b62047c-54, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=467e7a2e-60f3-4c38-837f-6d93d372df0c) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:03 user nova-compute[75288]: INFO os_vif [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:74:f2,bridge_name='br-int',has_traffic_filtering=True,id=3b62047c-54d3-41ba-a037-230d76298105,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b62047c-54')
Nov 10 23:07:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Deleting instance files /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45_del
Nov 10 23:07:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Deletion of /opt/stack/data/nova/instances/ad132b9c-5de3-4d1a-ab55-4e95d589df45_del complete
Nov 10 23:07:03 user nova-compute[75288]: INFO nova.compute.manager [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 23:07:03 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:07:03 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Took 0.45 seconds to deallocate network for instance.
Nov 10 23:07:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-0bf12594-c38f-42e0-92ff-2f8b1fb21021 req-cb819abe-139e-4163-992d-099cfff12c9b service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-deleted-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:04 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Deleted allocations for instance ad132b9c-5de3-4d1a-ab55-4e95d589df45
Nov 10 23:07:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e9575094-87fd-415e-9281-5d8228ef2f6f tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.769s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-425672e3-e889-45db-9544-fa5f0371b04f req-21dc1454-3fb6-40ea-bf7e-05f7c5cd67c5 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-425672e3-e889-45db-9544-fa5f0371b04f req-21dc1454-3fb6-40ea-bf7e-05f7c5cd67c5 service nova] Acquiring lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-425672e3-e889-45db-9544-fa5f0371b04f req-21dc1454-3fb6-40ea-bf7e-05f7c5cd67c5 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-425672e3-e889-45db-9544-fa5f0371b04f req-21dc1454-3fb6-40ea-bf7e-05f7c5cd67c5 service nova] Lock "ad132b9c-5de3-4d1a-ab55-4e95d589df45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-425672e3-e889-45db-9544-fa5f0371b04f req-21dc1454-3fb6-40ea-bf7e-05f7c5cd67c5 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] No waiting events found dispatching network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:04 user nova-compute[75288]: WARNING nova.compute.manager [req-425672e3-e889-45db-9544-fa5f0371b04f req-21dc1454-3fb6-40ea-bf7e-05f7c5cd67c5 service nova] [instance: ad132b9c-5de3-4d1a-ab55-4e95d589df45] Received unexpected event network-vif-plugged-3b62047c-54d3-41ba-a037-230d76298105 for instance with vm_state deleted and task_state None.
Nov 10 23:07:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:21 user nova-compute[75288]: INFO nova.compute.manager [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Terminating instance
Nov 10 23:07:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-a19007c3-0387-4baf-bcf4-0daff090ac91 req-7ea18336-25f8-4e2b-a01a-f392c22ef32f service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-vif-unplugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a19007c3-0387-4baf-bcf4-0daff090ac91 req-7ea18336-25f8-4e2b-a01a-f392c22ef32f service nova] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a19007c3-0387-4baf-bcf4-0daff090ac91 req-7ea18336-25f8-4e2b-a01a-f392c22ef32f service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a19007c3-0387-4baf-bcf4-0daff090ac91 req-7ea18336-25f8-4e2b-a01a-f392c22ef32f service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-a19007c3-0387-4baf-bcf4-0daff090ac91 req-7ea18336-25f8-4e2b-a01a-f392c22ef32f service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] No waiting events found dispatching network-vif-unplugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-a19007c3-0387-4baf-bcf4-0daff090ac91 req-7ea18336-25f8-4e2b-a01a-f392c22ef32f service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-vif-unplugged-461abdd7-f99c-4658-a51f-459894fd78fe for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Instance destroyed successfully.
Nov 10 23:07:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'resources' on Instance uuid 67ca352f-960d-44d9-9862-06102cfb029b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1221145440',display_name='tempest-AttachVolumeNegativeTest-server-1221145440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1221145440',id=39,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYP20dDVvkpaLLfwnJV1SD04z4z9ST5UnKC/rmThuFjCZbjy3IZSk/aYuckJiX81B9DZeFfqdiguVDFurDw9o2LZ9ja27ld00RmGSGQc3cx5WvA+ImFhWlHcnx2xyS5qg==',key_name='tempest-keypair-1825702553',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-ju2s3jqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=67ca352f-960d-44d9-9862-06102cfb029b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "461abdd7-f99c-4658-a51f-459894fd78fe", "address": "fa:16:3e:9a:70:51", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap461abdd7-f9", "ovs_interfaceid": "461abdd7-f99c-4658-a51f-459894fd78fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:70:51,bridge_name='br-int',has_traffic_filtering=True,id=461abdd7-f99c-4658-a51f-459894fd78fe,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap461abdd7-f9') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG os_vif [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:70:51,bridge_name='br-int',has_traffic_filtering=True,id=461abdd7-f99c-4658-a51f-459894fd78fe,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap461abdd7-f9') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap461abdd7-f9, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1db9a22b-c0d0-4157-b445-aa658b6e4c84) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:22 user nova-compute[75288]: INFO os_vif [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:70:51,bridge_name='br-int',has_traffic_filtering=True,id=461abdd7-f99c-4658-a51f-459894fd78fe,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap461abdd7-f9')
Nov 10 23:07:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Deleting instance files /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b_del
Nov 10 23:07:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Deletion of /opt/stack/data/nova/instances/67ca352f-960d-44d9-9862-06102cfb029b_del complete
Nov 10 23:07:22 user nova-compute[75288]: INFO nova.compute.manager [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 23:07:22 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:07:22 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:07:23 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Took 0.94 seconds to deallocate network for instance.
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fedcf22-c0f0-43f2-b8c8-7890105bf5ad req-6b73e59b-dd59-48ee-b3c7-7b17c038c7eb service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-vif-deleted-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:23 user nova-compute[75288]: INFO nova.compute.manager [req-7fedcf22-c0f0-43f2-b8c8-7890105bf5ad req-6b73e59b-dd59-48ee-b3c7-7b17c038c7eb service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Neutron deleted interface 461abdd7-f99c-4658-a51f-459894fd78fe; detaching it from the instance and deleting it from the info cache
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-7fedcf22-c0f0-43f2-b8c8-7890105bf5ad req-6b73e59b-dd59-48ee-b3c7-7b17c038c7eb service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fedcf22-c0f0-43f2-b8c8-7890105bf5ad req-6b73e59b-dd59-48ee-b3c7-7b17c038c7eb service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Detach interface failed, port_id=461abdd7-f99c-4658-a51f-459894fd78fe, reason: Instance 67ca352f-960d-44d9-9862-06102cfb029b could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:23 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Deleted allocations for instance 67ca352f-960d-44d9-9862-06102cfb029b
Nov 10 23:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2de209dc-8beb-414b-ad6c-d8a26a36e154 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "67ca352f-960d-44d9-9862-06102cfb029b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-3f39703d-54ca-4408-bee7-e7692c10ff8e req-648794ea-7f48-47ab-8b0f-6699c84ec0f1 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received event network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3f39703d-54ca-4408-bee7-e7692c10ff8e req-648794ea-7f48-47ab-8b0f-6699c84ec0f1 service nova] Acquiring lock "67ca352f-960d-44d9-9862-06102cfb029b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3f39703d-54ca-4408-bee7-e7692c10ff8e req-648794ea-7f48-47ab-8b0f-6699c84ec0f1 service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3f39703d-54ca-4408-bee7-e7692c10ff8e req-648794ea-7f48-47ab-8b0f-6699c84ec0f1 service nova] Lock "67ca352f-960d-44d9-9862-06102cfb029b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-3f39703d-54ca-4408-bee7-e7692c10ff8e req-648794ea-7f48-47ab-8b0f-6699c84ec0f1 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] No waiting events found dispatching network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:23 user nova-compute[75288]: WARNING nova.compute.manager [req-3f39703d-54ca-4408-bee7-e7692c10ff8e req-648794ea-7f48-47ab-8b0f-6699c84ec0f1 service nova] [instance: 67ca352f-960d-44d9-9862-06102cfb029b] Received unexpected event network-vif-plugged-461abdd7-f99c-4658-a51f-459894fd78fe for instance with vm_state deleted and task_state None.
Nov 10 23:07:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing instance network info cache due to event network-changed-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] Acquiring lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] Acquired lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Refreshing network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:35 user nova-compute[75288]: INFO nova.compute.manager [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Terminating instance
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updated VIF entry in instance network info cache for port e66bcde8-1a94-4b2b-b7f5-852a754c8f5d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [{"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-522886ac-ea58-49f4-b2c7-cc4a02775164 req-f9f618f1-24dd-4fa3-99c2-bb9d866c11de service nova] Releasing lock "refresh_cache-73b43004-5b50-4f05-a082-d59af20b6496" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:07:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Instance destroyed successfully.
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lazy-loading 'resources' on Instance uuid 73b43004-5b50-4f05-a082-d59af20b6496 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T23:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960437778',display_name='tempest-TestShelveInstance-server-1960437778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960437778',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmHVhExr7lbPtKRyZtoqtSU9E8RUajl8Qyppo53C1XB8xNneYgr6uru5V34zaHL25eMCX0WUN3DkjLNm5CAe5hSb3SM0bmE0S1nZrMWaacHmic/leLzCjMKETJErw30lA==',key_name='tempest-TestShelveInstance-851294927',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4405c403b8e4365975b2b3a885c5146',ramdisk_id='',reservation_id='r-hw7cn7zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872213000',owner_user_name='tempest-TestShelveInstance-872213000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:06:28Z,user_data=None,user_id='09d92fe49e244ab1a8d44d44e350dc51',uuid=73b43004-5b50-4f05-a082-d59af20b6496,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converting VIF {"id": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "address": "fa:16:3e:3a:1c:b7", "network": {"id": "7f680633-ca04-42a3-a286-4d8b6edb36a8", "bridge": "br-int", "label": "tempest-TestShelveInstance-354950942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4405c403b8e4365975b2b3a885c5146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66bcde8-1a", "ovs_interfaceid": "e66bcde8-1a94-4b2b-b7f5-852a754c8f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:07:35 user nova-compute[75288]: DEBUG os_vif [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape66bcde8-1a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=256f607e-dbca-443e-b87a-aefd9f9e91e8) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:36 user nova-compute[75288]: INFO os_vif [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1c:b7,bridge_name='br-int',has_traffic_filtering=True,id=e66bcde8-1a94-4b2b-b7f5-852a754c8f5d,network=Network(7f680633-ca04-42a3-a286-4d8b6edb36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66bcde8-1a')
Nov 10 23:07:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASpCPGcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:07:36 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-25150ae2-6777-465b-8d57-cf8a885480e2 req-c93bf9b1-1f30-441c-bf03-620960452c54 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-unplugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-25150ae2-6777-465b-8d57-cf8a885480e2 req-c93bf9b1-1f30-441c-bf03-620960452c54 service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-25150ae2-6777-465b-8d57-cf8a885480e2 req-c93bf9b1-1f30-441c-bf03-620960452c54 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-25150ae2-6777-465b-8d57-cf8a885480e2 req-c93bf9b1-1f30-441c-bf03-620960452c54 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-25150ae2-6777-465b-8d57-cf8a885480e2 req-c93bf9b1-1f30-441c-bf03-620960452c54 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-unplugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-25150ae2-6777-465b-8d57-cf8a885480e2 req-c93bf9b1-1f30-441c-bf03-620960452c54 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-unplugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[059acb50-351e-4138-8164-38d39b3fb4ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:07:36 user nova-compute[75288]: No targets found.
Nov 10 23:07:36 user nova-compute[75288]: iSNS:
Nov 10 23:07:36 user nova-compute[75288]: No targets found.
Nov 10 23:07:36 user nova-compute[75288]: STATIC:
Nov 10 23:07:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae
Nov 10 23:07:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:07:36 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:07:36 user nova-compute[75288]: FIRMWARE:
Nov 10 23:07:36 user nova-compute[75288]: No targets found.
Nov 10 23:07:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:07:36 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:07:36 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a1cf9-26c5-4d9b-aa5b-6ad28760909b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6354f7fe-1d7a-4beb-92a9-3f3ea683efc1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:07:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae (non-flash)
Nov 10 23:07:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b107e2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[802f0fda-f5fb-4842-baa0-f218d1368dd6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[988b425f-4cb5-4671-8ec4-e68c253a43f0]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c304f3-1e5e-4633-8607-5c05434e6fbf]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd7fdef-cf80-4a55-8ea2-d26773efb33c]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e12aad6c', '/dev/disk/by-id/scsi-1SCST_BIOe12aad6c-189904df03b26fb7', '/dev/disk/by-id/scsi-23138393930346466') {{(pid=86709) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dbe483-8288-46eb-8df7-35859147cc76]: (4, None) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9226f124-2762-417c-8c7a-50c4ca608e83]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e64edd-5923-47ef-b91b-9cd37079ff31]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260]
Nov 10 23:07:36 user nova-compute[75288]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae, portal: 172.16.0.220,3260] successful.
Nov 10 23:07:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1276ebc-9789-44a6-bad2-122e46529aae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a210ed30-cdad-4c18-a752-f04ab1806e2f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] <== disconnect_volume: return (332ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:07:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Deleting instance files /opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496_del
Nov 10 23:07:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Deletion of /opt/stack/data/nova/instances/73b43004-5b50-4f05-a082-d59af20b6496_del complete
Nov 10 23:07:36 user nova-compute[75288]: INFO nova.compute.manager [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 10 23:07:36 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:07:36 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:07:37 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:07:37 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Took 0.64 seconds to deallocate network for instance.
Nov 10 23:07:38 user nova-compute[75288]: INFO nova.compute.manager [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Took 0.99 seconds to detach 1 volumes for instance.
Nov 10 23:07:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Deleting volume: b1276ebc-9789-44a6-bad2-122e46529aae {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-cbbd3e41-e82b-4a34-9224-6b03146139ab req-f9c3eeb2-e407-4c0e-b834-408abe962733 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cbbd3e41-e82b-4a34-9224-6b03146139ab req-f9c3eeb2-e407-4c0e-b834-408abe962733 service nova] Acquiring lock "73b43004-5b50-4f05-a082-d59af20b6496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cbbd3e41-e82b-4a34-9224-6b03146139ab req-f9c3eeb2-e407-4c0e-b834-408abe962733 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cbbd3e41-e82b-4a34-9224-6b03146139ab req-f9c3eeb2-e407-4c0e-b834-408abe962733 service nova] Lock "73b43004-5b50-4f05-a082-d59af20b6496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-cbbd3e41-e82b-4a34-9224-6b03146139ab req-f9c3eeb2-e407-4c0e-b834-408abe962733 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] No waiting events found dispatching network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:38 user nova-compute[75288]: WARNING nova.compute.manager [req-cbbd3e41-e82b-4a34-9224-6b03146139ab req-f9c3eeb2-e407-4c0e-b834-408abe962733 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received unexpected event network-vif-plugged-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d for instance with vm_state active and task_state deleting.
Nov 10 23:07:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-cbbd3e41-e82b-4a34-9224-6b03146139ab req-f9c3eeb2-e407-4c0e-b834-408abe962733 service nova] [instance: 73b43004-5b50-4f05-a082-d59af20b6496] Received event network-vif-deleted-e66bcde8-1a94-4b2b-b7f5-852a754c8f5d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:38 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Deleted allocations for instance 73b43004-5b50-4f05-a082-d59af20b6496
Nov 10 23:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9ecd8f62-fae8-4d70-a673-9c687ab00c49 tempest-TestShelveInstance-872213000 tempest-TestShelveInstance-872213000-project-member] Lock "73b43004-5b50-4f05-a082-d59af20b6496" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:07:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:07:42 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:07:42 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:07:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.053783416748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:07:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:07:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:07:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:53 user nova-compute[75288]: INFO nova.compute.manager [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Terminating instance
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-6c27b073-6ccc-4af0-8d22-041233660064 req-21673474-6760-4b3a-b3f8-c919ad247c55 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6c27b073-6ccc-4af0-8d22-041233660064 req-21673474-6760-4b3a-b3f8-c919ad247c55 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6c27b073-6ccc-4af0-8d22-041233660064 req-21673474-6760-4b3a-b3f8-c919ad247c55 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6c27b073-6ccc-4af0-8d22-041233660064 req-21673474-6760-4b3a-b3f8-c919ad247c55 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-6c27b073-6ccc-4af0-8d22-041233660064 req-21673474-6760-4b3a-b3f8-c919ad247c55 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-6c27b073-6ccc-4af0-8d22-041233660064 req-21673474-6760-4b3a-b3f8-c919ad247c55 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Instance destroyed successfully.
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lazy-loading 'resources' on Instance uuid 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T22:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-449796295',display_name='tempest-ServerRescueNegativeTestJSON-server-449796295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-449796295',id=28,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T22:54:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fb8bee5841243ecbc00a012f27016fe',ramdisk_id='',reservation_id='r-jfvj441o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423881024',owner_user_name='tempest-ServerRescueNegativeTestJSON-423881024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T22:56:42Z,user_data=None,user_id='8aa64d78d0ed47e9af81121ea1e9e34a',uuid=0c73ba31-10a8-483a-9fcc-fe0beeeffba8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converting VIF {"id": "a23e0df0-18b8-4950-9f59-5150861a4c28", "address": "fa:16:3e:04:76:81", "network": {"id": "957f1700-db68-4533-95f3-e68542da8ce5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2031746230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fb8bee5841243ecbc00a012f27016fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23e0df0-18", "ovs_interfaceid": "a23e0df0-18b8-4950-9f59-5150861a4c28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG os_vif [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa23e0df0-18, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=976d958f-cc38-4e0b-8e13-f8dc6df8cbec) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:53 user nova-compute[75288]: INFO os_vif [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:76:81,bridge_name='br-int',has_traffic_filtering=True,id=a23e0df0-18b8-4950-9f59-5150861a4c28,network=Network(957f1700-db68-4533-95f3-e68542da8ce5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23e0df0-18')
Nov 10 23:07:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Deleting instance files /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8_del
Nov 10 23:07:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Deletion of /opt/stack/data/nova/instances/0c73ba31-10a8-483a-9fcc-fe0beeeffba8_del complete
Nov 10 23:07:54 user nova-compute[75288]: INFO nova.compute.manager [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 23:07:54 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:07:54 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:07:54 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:07:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:07:55 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Took 0.98 seconds to deallocate network for instance.
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-016ff329-9eca-4e6b-ba29-110d035615de req-031184af-104f-47ce-8e34-1134a8889c80 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-deleted-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:55 user nova-compute[75288]: INFO nova.compute.manager [req-016ff329-9eca-4e6b-ba29-110d035615de req-031184af-104f-47ce-8e34-1134a8889c80 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Neutron deleted interface a23e0df0-18b8-4950-9f59-5150861a4c28; detaching it from the instance and deleting it from the info cache
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-016ff329-9eca-4e6b-ba29-110d035615de req-031184af-104f-47ce-8e34-1134a8889c80 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-016ff329-9eca-4e6b-ba29-110d035615de req-031184af-104f-47ce-8e34-1134a8889c80 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Detach interface failed, port_id=a23e0df0-18b8-4950-9f59-5150861a4c28, reason: Instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:55 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Deleted allocations for instance 0c73ba31-10a8-483a-9fcc-fe0beeeffba8
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-775caf95-2aef-4be2-88ea-b96d5d414281 tempest-ServerRescueNegativeTestJSON-423881024 tempest-ServerRescueNegativeTestJSON-423881024-project-member] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:55 user nova-compute[75288]: WARNING nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state deleted and task_state None.
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:55 user nova-compute[75288]: WARNING nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state deleted and task_state None.
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:55 user nova-compute[75288]: WARNING nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state deleted and task_state None.
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:55 user nova-compute[75288]: WARNING nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-unplugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state deleted and task_state None.
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Acquiring lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] Lock "0c73ba31-10a8-483a-9fcc-fe0beeeffba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] No waiting events found dispatching network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:07:55 user nova-compute[75288]: WARNING nova.compute.manager [req-1aacc62f-41e1-40af-98cd-53f549f53f45 req-5ca328e7-b2c7-45be-a492-de1f5b806a29 service nova] [instance: 0c73ba31-10a8-483a-9fcc-fe0beeeffba8] Received unexpected event network-vif-plugged-a23e0df0-18b8-4950-9f59-5150861a4c28 for instance with vm_state deleted and task_state None.
Nov 10 23:07:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:07:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:07:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:07:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:02 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:08:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:08:14 user nova-compute[75288]: INFO nova.compute.claims [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Claim successful on node user
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:08:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.policy [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fd540ceafe84c2b877de1d038b28b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e470a0a6d2f74fad84a1f1f738e8383d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:08:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Creating image(s)
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "/opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Successfully created port: 179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk 1073741824" returned: 0 in 0.143s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Cannot resize image /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Ensure instance console log exists: /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Successfully updated port: 179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquired lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-changed-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Refreshing instance network info cache due to event network-changed-179ceef5-4d78-4467-9236-b52b8e6a8d91. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] Acquiring lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:08:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updating instance_info_cache with network_info: [{"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Releasing lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Instance network_info: |[{"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] Acquired lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Refreshing network info cache for port 179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Start _get_guest_xml network_info=[{"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:08:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:08:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1701099630',display_name='tempest-AttachVolumeNegativeTest-server-1701099630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1701099630',id=43,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGet3uxpzhoxIv9X6sSfF2KmtMTl3zVMNhf/ygIOrGu1pTl/NNedhpCsaSeI1XDMJDbOtSVsbTMnSvU0G5iArEEPLflXFNDjvZvEKjWS4SEqKh5maJblQZDqbYSCq+/51g==',key_name='tempest-keypair-1868482537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-vjsj4325',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=450b0f72-f999-48da-80e7-9af78aa4840a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:11:70,bridge_name='br-int',has_traffic_filtering=True,id=179ceef5-4d78-4467-9236-b52b8e6a8d91,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179ceef5-4d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'pci_devices' on Instance uuid 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:08:17 user nova-compute[75288]:   <uuid>450b0f72-f999-48da-80e7-9af78aa4840a</uuid>
Nov 10 23:08:17 user nova-compute[75288]:   <name>instance-0000002b</name>
Nov 10 23:08:17 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:08:17 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:08:17 user nova-compute[75288]:   <metadata>
Nov 10 23:08:17 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:08:17 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:08:17 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1701099630</nova:name>
Nov 10 23:08:17 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:08:17</nova:creationTime>
Nov 10 23:08:17 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:08:17 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:08:17 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:08:17 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:08:17 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:08:17 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:08:17 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:08:17 user nova-compute[75288]:       <nova:owner>
Nov 10 23:08:17 user nova-compute[75288]:         <nova:user uuid="7fd540ceafe84c2b877de1d038b28b73">tempest-AttachVolumeNegativeTest-239737587-project-member</nova:user>
Nov 10 23:08:17 user nova-compute[75288]:         <nova:project uuid="e470a0a6d2f74fad84a1f1f738e8383d">tempest-AttachVolumeNegativeTest-239737587</nova:project>
Nov 10 23:08:17 user nova-compute[75288]:       </nova:owner>
Nov 10 23:08:17 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 23:08:17 user nova-compute[75288]:       <nova:ports>
Nov 10 23:08:17 user nova-compute[75288]:         <nova:port uuid="179ceef5-4d78-4467-9236-b52b8e6a8d91">
Nov 10 23:08:17 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 23:08:17 user nova-compute[75288]:         </nova:port>
Nov 10 23:08:17 user nova-compute[75288]:       </nova:ports>
Nov 10 23:08:17 user nova-compute[75288]:     </nova:instance>
Nov 10 23:08:17 user nova-compute[75288]:   </metadata>
Nov 10 23:08:17 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:08:17 user nova-compute[75288]:     <system>
Nov 10 23:08:17 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:08:17 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:08:17 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:08:17 user nova-compute[75288]:       <entry name="serial">450b0f72-f999-48da-80e7-9af78aa4840a</entry>
Nov 10 23:08:17 user nova-compute[75288]:       <entry name="uuid">450b0f72-f999-48da-80e7-9af78aa4840a</entry>
Nov 10 23:08:17 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:08:17 user nova-compute[75288]:     </system>
Nov 10 23:08:17 user nova-compute[75288]:   </sysinfo>
Nov 10 23:08:17 user nova-compute[75288]:   <os>
Nov 10 23:08:17 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:08:17 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:08:17 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:08:17 user nova-compute[75288]:   </os>
Nov 10 23:08:17 user nova-compute[75288]:   <features>
Nov 10 23:08:17 user nova-compute[75288]:     <acpi/>
Nov 10 23:08:17 user nova-compute[75288]:     <apic/>
Nov 10 23:08:17 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:08:17 user nova-compute[75288]:   </features>
Nov 10 23:08:17 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:08:17 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:08:17 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:08:17 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:08:17 user nova-compute[75288]:   </clock>
Nov 10 23:08:17 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:08:17 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:08:17 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:08:17 user nova-compute[75288]:   </cpu>
Nov 10 23:08:17 user nova-compute[75288]:   <devices>
Nov 10 23:08:17 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:08:17 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:08:17 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk"/>
Nov 10 23:08:17 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:08:17 user nova-compute[75288]:     </disk>
Nov 10 23:08:17 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:08:17 user nova-compute[75288]:       <mac address="fa:16:3e:52:11:70"/>
Nov 10 23:08:17 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:08:17 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:08:17 user nova-compute[75288]:       <target dev="tap179ceef5-4d"/>
Nov 10 23:08:17 user nova-compute[75288]:     </interface>
Nov 10 23:08:17 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:08:17 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/console.log" append="off"/>
Nov 10 23:08:17 user nova-compute[75288]:     </serial>
Nov 10 23:08:17 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:08:17 user nova-compute[75288]:     <video>
Nov 10 23:08:17 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:08:17 user nova-compute[75288]:     </video>
Nov 10 23:08:17 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:08:17 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:08:17 user nova-compute[75288]:     </rng>
Nov 10 23:08:17 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:08:17 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:08:17 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:08:17 user nova-compute[75288]:     </memballoon>
Nov 10 23:08:17 user nova-compute[75288]:   </devices>
Nov 10 23:08:17 user nova-compute[75288]: </domain>
Nov 10 23:08:17 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1701099630',display_name='tempest-AttachVolumeNegativeTest-server-1701099630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1701099630',id=43,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGet3uxpzhoxIv9X6sSfF2KmtMTl3zVMNhf/ygIOrGu1pTl/NNedhpCsaSeI1XDMJDbOtSVsbTMnSvU0G5iArEEPLflXFNDjvZvEKjWS4SEqKh5maJblQZDqbYSCq+/51g==',key_name='tempest-keypair-1868482537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-vjsj4325',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=450b0f72-f999-48da-80e7-9af78aa4840a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:11:70,bridge_name='br-int',has_traffic_filtering=True,id=179ceef5-4d78-4467-9236-b52b8e6a8d91,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179ceef5-4d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG os_vif [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:11:70,bridge_name='br-int',has_traffic_filtering=True,id=179ceef5-4d78-4467-9236-b52b8e6a8d91,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179ceef5-4d') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a6678c6-31c1-55f2-ada7-b2a0b4792705', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap179ceef5-4d, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap179ceef5-4d, col_values=(('qos', UUID('229c8375-aaa0-4be5-8436-2995ec03761a')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap179ceef5-4d, col_values=(('external_ids', {'iface-id': '179ceef5-4d78-4467-9236-b52b8e6a8d91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:11:70', 'vm-uuid': '450b0f72-f999-48da-80e7-9af78aa4840a'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:17 user nova-compute[75288]: INFO os_vif [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:11:70,bridge_name='br-int',has_traffic_filtering=True,id=179ceef5-4d78-4467-9236-b52b8e6a8d91,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179ceef5-4d')
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No VIF found with MAC fa:16:3e:52:11:70, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updated VIF entry in instance network info cache for port 179ceef5-4d78-4467-9236-b52b8e6a8d91. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updating instance_info_cache with network_info: [{"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf7b38a9-d863-419b-9ad8-273b5281b636 req-2406b62e-de23-4fcb-8661-e94d9765e3cf service nova] Releasing lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:08:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-15c3247f-e97e-4851-8634-6fae02ef79d0 req-e297d91d-4e32-4bf8-b151-802b4d9d03cc service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:08:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15c3247f-e97e-4851-8634-6fae02ef79d0 req-e297d91d-4e32-4bf8-b151-802b4d9d03cc service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15c3247f-e97e-4851-8634-6fae02ef79d0 req-e297d91d-4e32-4bf8-b151-802b4d9d03cc service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15c3247f-e97e-4851-8634-6fae02ef79d0 req-e297d91d-4e32-4bf8-b151-802b4d9d03cc service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-15c3247f-e97e-4851-8634-6fae02ef79d0 req-e297d91d-4e32-4bf8-b151-802b4d9d03cc service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:08:19 user nova-compute[75288]: WARNING nova.compute.manager [req-15c3247f-e97e-4851-8634-6fae02ef79d0 req-e297d91d-4e32-4bf8-b151-802b4d9d03cc service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received unexpected event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with vm_state building and task_state spawning.
Nov 10 23:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:08:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Instance spawned successfully.
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:08:20 user nova-compute[75288]: INFO nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 10 23:08:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:08:20 user nova-compute[75288]: INFO nova.compute.manager [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Took 6.04 seconds to build instance.
Nov 10 23:08:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ddf962a4-b8a1-4303-869d-ef3b32e24131 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.132s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-9c399561-b579-4c03-8db7-deca40129885 req-0e868161-54f2-4c7f-9d56-cc90663f1c13 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:08:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9c399561-b579-4c03-8db7-deca40129885 req-0e868161-54f2-4c7f-9d56-cc90663f1c13 service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9c399561-b579-4c03-8db7-deca40129885 req-0e868161-54f2-4c7f-9d56-cc90663f1c13 service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9c399561-b579-4c03-8db7-deca40129885 req-0e868161-54f2-4c7f-9d56-cc90663f1c13 service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-9c399561-b579-4c03-8db7-deca40129885 req-0e868161-54f2-4c7f-9d56-cc90663f1c13 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:08:21 user nova-compute[75288]: WARNING nova.compute.manager [req-9c399561-b579-4c03-8db7-deca40129885 req-0e868161-54f2-4c7f-9d56-cc90663f1c13 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received unexpected event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with vm_state active and task_state None.
Nov 10 23:08:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "81873c5c-8554-4bbd-a80d-6498971c4382" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "81873c5c-8554-4bbd-a80d-6498971c4382" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:08:35 user nova-compute[75288]: INFO nova.compute.claims [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Claim successful on node user
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:08:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:08:35 user nova-compute[75288]: INFO nova.virt.block_device [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Booting with volume snapshot a8edb9e0-ce26-4153-9fb9-0a7a0051ede5 at /dev/vda
Nov 10 23:08:35 user nova-compute[75288]: DEBUG nova.policy [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa19686e14744c0dbbd437aee915f870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2793e892931b4463b6f44fa9bf6da539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:08:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Successfully created port: 2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Successfully updated port: 2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "refresh_cache-81873c5c-8554-4bbd-a80d-6498971c4382" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquired lock "refresh_cache-81873c5c-8554-4bbd-a80d-6498971c4382" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received event network-changed-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Refreshing instance network info cache due to event network-changed-2bc5d0a8-4492-43a9-9223-cc39a13e7a14. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] Acquiring lock "refresh_cache-81873c5c-8554-4bbd-a80d-6498971c4382" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:08:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Updating instance_info_cache with network_info: [{"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Releasing lock "refresh_cache-81873c5c-8554-4bbd-a80d-6498971c4382" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Instance network_info: |[{"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] Acquired lock "refresh_cache-81873c5c-8554-4bbd-a80d-6498971c4382" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Refreshing network info cache for port 2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Updated VIF entry in instance network info cache for port 2bc5d0a8-4492-43a9-9223-cc39a13e7a14. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Updating instance_info_cache with network_info: [{"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3382f90e-bc0d-4e03-9a1b-0a8c11135569 req-ff075489-ead4-425a-8bb9-10fdbc4667c6 service nova] Releasing lock "refresh_cache-81873c5c-8554-4bbd-a80d-6498971c4382" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:08:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG os_brick.utils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaacb821-adbb-4622-9a95-28df08258cf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[88572ac2-988e-42c8-bc86-1a203e05f8b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[337b223b-d813-449f-a62b-32d54f100184]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab957c89-e09e-4561-9292-7a78cde55f8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:08:41 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4d5ce-069c-44a1-9a42-4fa9a6885ec5]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG os_brick.utils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Updating existing volume attachment record: e42f10d9-f0fd-4128-be36-3e65793c3adf {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:08:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:08:42 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:08:42 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=25.090782165527344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 450b0f72-f999-48da-80e7-9af78aa4840a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 81873c5c-8554-4bbd-a80d-6498971c4382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:08:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Skipping network cache update for instance because it is Building. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:08:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:08:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updating instance_info_cache with network_info: [{"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:08:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:08:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:08:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:54 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:08:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:08:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:08:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:04 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:09:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:09:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:09:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:09:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:09:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:09:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Creating image(s)
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Ensure instance console log exists: /opt/stack/data/nova/instances/81873c5c-8554-4bbd-a80d-6498971c4382/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Start _get_guest_xml network_info=[{"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATvrRsnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81873c5c-8554-4bbd-a80d-6498971c4382', 'attached_at': '', 'detached_at': '', 'volume_id': '458e0aa2-f645-49de-b92f-7790a65d2e3b', 'serial': '458e0aa2-f645-49de-b92f-7790a65d2e3b'}, 'mount_device': '/dev/vda', 'attachment_id': 'e42f10d9-f0fd-4128-be36-3e65793c3adf', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:09:09 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:09:09 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATvrRsnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:09:09 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:09:09 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:09:09 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab21ed29-c180-4116-83e1-d979ed1b3c35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:09:09 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0203ef-010d-4b77-a2c1-f66098dbd5e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b] added
Nov 10 23:09:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab2b89f-0900-48bc-aa21-1eb122121325]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be314b6-5456-4586-89e6-9c9c957b8707]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ATvrRsnp {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ATvrRsnp" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7009bae2-087a-4ece-89f5-416cc13cf627]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ATvrRsnp'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b9df3-c2be-4294-b428-65ae531bc4b6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef2b8b7-870b-455b-b3b0-d2ac6d2c3b94]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:09:10 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:09:10 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:09:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 23:09:10 user nova-compute[75288]: 
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c171aa3-3dcd-4660-b124-2966e4cc073c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260]
Nov 10 23:09:10 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260] successful.
Nov 10 23:09:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[077715ca-4778-4727-b557-78d9a60b926e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a800f591-a831-4342-a4a4-391b002a2978]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b (non-flash)
Nov 10 23:09:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b (non-flash)
Nov 10 23:09:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e721881-5492-429f-8ffc-8d3296cb0cb1]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:09:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATvrRsnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23535393334626130', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535393334626130', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-940443063',display_name='tempest-TestVolumeBootPattern-server-940443063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-940443063',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-cm3wjn4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:08:36Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=81873c5c-8554-4bbd-a80d-6498971c4382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:27,bridge_name='br-int',has_traffic_filtering=True,id=2bc5d0a8-4492-43a9-9223-cc39a13e7a14,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bc5d0a8-44') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'pci_devices' on Instance uuid 81873c5c-8554-4bbd-a80d-6498971c4382 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:09:11 user nova-compute[75288]:   <uuid>81873c5c-8554-4bbd-a80d-6498971c4382</uuid>
Nov 10 23:09:11 user nova-compute[75288]:   <name>instance-0000002c</name>
Nov 10 23:09:11 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:09:11 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:09:11 user nova-compute[75288]:   <metadata>
Nov 10 23:09:11 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:09:11 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:09:11 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-940443063</nova:name>
Nov 10 23:09:11 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:09:09</nova:creationTime>
Nov 10 23:09:11 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:09:11 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:09:11 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:09:11 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:09:11 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:09:11 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:09:11 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:09:11 user nova-compute[75288]:       <nova:owner>
Nov 10 23:09:11 user nova-compute[75288]:         <nova:user uuid="aa19686e14744c0dbbd437aee915f870">tempest-TestVolumeBootPattern-799029960-project-member</nova:user>
Nov 10 23:09:11 user nova-compute[75288]:         <nova:project uuid="2793e892931b4463b6f44fa9bf6da539">tempest-TestVolumeBootPattern-799029960</nova:project>
Nov 10 23:09:11 user nova-compute[75288]:       </nova:owner>
Nov 10 23:09:11 user nova-compute[75288]:       <nova:ports>
Nov 10 23:09:11 user nova-compute[75288]:         <nova:port uuid="2bc5d0a8-4492-43a9-9223-cc39a13e7a14">
Nov 10 23:09:11 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 23:09:11 user nova-compute[75288]:         </nova:port>
Nov 10 23:09:11 user nova-compute[75288]:       </nova:ports>
Nov 10 23:09:11 user nova-compute[75288]:     </nova:instance>
Nov 10 23:09:11 user nova-compute[75288]:   </metadata>
Nov 10 23:09:11 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:09:11 user nova-compute[75288]:     <system>
Nov 10 23:09:11 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:09:11 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:09:11 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:09:11 user nova-compute[75288]:       <entry name="serial">81873c5c-8554-4bbd-a80d-6498971c4382</entry>
Nov 10 23:09:11 user nova-compute[75288]:       <entry name="uuid">81873c5c-8554-4bbd-a80d-6498971c4382</entry>
Nov 10 23:09:11 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:09:11 user nova-compute[75288]:     </system>
Nov 10 23:09:11 user nova-compute[75288]:   </sysinfo>
Nov 10 23:09:11 user nova-compute[75288]:   <os>
Nov 10 23:09:11 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:09:11 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:09:11 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:09:11 user nova-compute[75288]:   </os>
Nov 10 23:09:11 user nova-compute[75288]:   <features>
Nov 10 23:09:11 user nova-compute[75288]:     <acpi/>
Nov 10 23:09:11 user nova-compute[75288]:     <apic/>
Nov 10 23:09:11 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:09:11 user nova-compute[75288]:   </features>
Nov 10 23:09:11 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:09:11 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:09:11 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:09:11 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:09:11 user nova-compute[75288]:   </clock>
Nov 10 23:09:11 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:09:11 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:09:11 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:09:11 user nova-compute[75288]:   </cpu>
Nov 10 23:09:11 user nova-compute[75288]:   <devices>
Nov 10 23:09:11 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 23:09:11 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:09:11 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 23:09:11 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:09:11 user nova-compute[75288]:       <serial>458e0aa2-f645-49de-b92f-7790a65d2e3b</serial>
Nov 10 23:09:11 user nova-compute[75288]:     </disk>
Nov 10 23:09:11 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:09:11 user nova-compute[75288]:       <mac address="fa:16:3e:1e:5a:27"/>
Nov 10 23:09:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:09:11 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:09:11 user nova-compute[75288]:       <target dev="tap2bc5d0a8-44"/>
Nov 10 23:09:11 user nova-compute[75288]:     </interface>
Nov 10 23:09:11 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:09:11 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/81873c5c-8554-4bbd-a80d-6498971c4382/console.log" append="off"/>
Nov 10 23:09:11 user nova-compute[75288]:     </serial>
Nov 10 23:09:11 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:09:11 user nova-compute[75288]:     <video>
Nov 10 23:09:11 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:09:11 user nova-compute[75288]:     </video>
Nov 10 23:09:11 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:09:11 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:09:11 user nova-compute[75288]:     </rng>
Nov 10 23:09:11 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:09:11 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:09:11 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:09:11 user nova-compute[75288]:     </memballoon>
Nov 10 23:09:11 user nova-compute[75288]:   </devices>
Nov 10 23:09:11 user nova-compute[75288]: </domain>
Nov 10 23:09:11 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-940443063',display_name='tempest-TestVolumeBootPattern-server-940443063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-940443063',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-cm3wjn4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:08:36Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=81873c5c-8554-4bbd-a80d-6498971c4382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:27,bridge_name='br-int',has_traffic_filtering=True,id=2bc5d0a8-4492-43a9-9223-cc39a13e7a14,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bc5d0a8-44') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG os_vif [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:27,bridge_name='br-int',has_traffic_filtering=True,id=2bc5d0a8-4492-43a9-9223-cc39a13e7a14,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bc5d0a8-44') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '595daf69-857a-5712-a34d-4192a62df98f', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bc5d0a8-44, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bc5d0a8-44, col_values=(('qos', UUID('5b167f9b-6784-4805-93ca-87130a3da3e7')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bc5d0a8-44, col_values=(('external_ids', {'iface-id': '2bc5d0a8-4492-43a9-9223-cc39a13e7a14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:5a:27', 'vm-uuid': '81873c5c-8554-4bbd-a80d-6498971c4382'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:11 user nova-compute[75288]: INFO os_vif [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:27,bridge_name='br-int',has_traffic_filtering=True,id=2bc5d0a8-4492-43a9-9223-cc39a13e7a14,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bc5d0a8-44')
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:09:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No VIF found with MAC fa:16:3e:1e:5a:27, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-e3581640-eb20-4b94-b595-5248c9a8c911 req-b52f8a09-7c1d-47b2-807f-1112280c73fb service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received event network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e3581640-eb20-4b94-b595-5248c9a8c911 req-b52f8a09-7c1d-47b2-807f-1112280c73fb service nova] Acquiring lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e3581640-eb20-4b94-b595-5248c9a8c911 req-b52f8a09-7c1d-47b2-807f-1112280c73fb service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e3581640-eb20-4b94-b595-5248c9a8c911 req-b52f8a09-7c1d-47b2-807f-1112280c73fb service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:09:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-e3581640-eb20-4b94-b595-5248c9a8c911 req-b52f8a09-7c1d-47b2-807f-1112280c73fb service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] No waiting events found dispatching network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:09:12 user nova-compute[75288]: WARNING nova.compute.manager [req-e3581640-eb20-4b94-b595-5248c9a8c911 req-b52f8a09-7c1d-47b2-807f-1112280c73fb service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received unexpected event network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 for instance with vm_state building and task_state spawning.
Nov 10 23:09:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:09:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Instance spawned successfully.
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:09:14 user nova-compute[75288]: INFO nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-055f6783-32b9-4fff-958e-725ec43637c3 req-cdd3bb29-a9e0-4607-9ee4-eb0b4beedf6f service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received event network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-055f6783-32b9-4fff-958e-725ec43637c3 req-cdd3bb29-a9e0-4607-9ee4-eb0b4beedf6f service nova] Acquiring lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-055f6783-32b9-4fff-958e-725ec43637c3 req-cdd3bb29-a9e0-4607-9ee4-eb0b4beedf6f service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-055f6783-32b9-4fff-958e-725ec43637c3 req-cdd3bb29-a9e0-4607-9ee4-eb0b4beedf6f service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:09:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-055f6783-32b9-4fff-958e-725ec43637c3 req-cdd3bb29-a9e0-4607-9ee4-eb0b4beedf6f service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] No waiting events found dispatching network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:09:14 user nova-compute[75288]: WARNING nova.compute.manager [req-055f6783-32b9-4fff-958e-725ec43637c3 req-cdd3bb29-a9e0-4607-9ee4-eb0b4beedf6f service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received unexpected event network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 for instance with vm_state building and task_state spawning.
Nov 10 23:09:14 user nova-compute[75288]: INFO nova.compute.manager [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Took 39.67 seconds to build instance.
Nov 10 23:09:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-62e0991b-1988-45be-9d21-ead7d8fbf165 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "81873c5c-8554-4bbd-a80d-6498971c4382" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.759s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:09:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:09:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:09:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:09:41 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:09:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:09:42 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:09:42 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=25.079212188720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 450b0f72-f999-48da-80e7-9af78aa4840a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 81873c5c-8554-4bbd-a80d-6498971c4382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:09:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:09:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:09:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:09:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updating instance_info_cache with network_info: [{"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:09:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:09:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:09:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:09:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:09:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:09:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:09:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:09:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:09:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:09:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:10:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-changed-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:10:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Refreshing instance network info cache due to event network-changed-179ceef5-4d78-4467-9236-b52b8e6a8d91. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] Acquiring lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] Acquired lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:10:05 user nova-compute[75288]: DEBUG nova.network.neutron [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Refreshing network info cache for port 179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updated VIF entry in instance network info cache for port 179ceef5-4d78-4467-9236-b52b8e6a8d91. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updating instance_info_cache with network_info: [{"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1de2af40-bab7-4bd9-8a48-22ce9e332061 req-16b84846-a206-4405-a88e-d01ef7656d67 service nova] Releasing lock "refresh_cache-450b0f72-f999-48da-80e7-9af78aa4840a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:10:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Verify base images {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Image id f7c29f6c-dbb5-44ff-8be6-262881085121 yields fingerprint f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] image f7c29f6c-dbb5-44ff-8be6-262881085121 at (/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec): checking
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] image f7c29f6c-dbb5-44ff-8be6-262881085121 at (/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec): image is in use {{(pid=75288) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] 450b0f72-f999-48da-80e7-9af78aa4840a is a valid instance name {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] 450b0f72-f999-48da-80e7-9af78aa4840a has a disk file {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 450b0f72-f999-48da-80e7-9af78aa4840a is backed by f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] 81873c5c-8554-4bbd-a80d-6498971c4382 is a valid instance name {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043
Nov 10 23:10:13 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Unknown base file: /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Active base files: /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Removable base files: /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07 /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5 /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805 /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7 /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043 /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/62f549f72d9f1fba3b2bb7ea93a045ed0dbe5e07
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca2907109b2f28eec9b46a2e53cb056451f87da5
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/51717fb9b5b1101b4f645471ef135a04d3fe7805
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bfcac65bb3b3ef22a9927655b0353458f63be8e7
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af7db2d73446cf288e24c95229033d80eca91e7c
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/71104f00a1bc629791b256fc0807ba916caa074c
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/607123c9e55cc09e0b80dd3aa9bcb2d9b7048043
Nov 10 23:10:13 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/49b86586779f0a1245eeddf6a4161ff263a430de
Nov 10 23:10:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Verification complete {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Verify swap images {{(pid=75288) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Verify ephemeral images {{(pid=75288) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:14 user nova-compute[75288]: INFO nova.compute.manager [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Attaching volume ef267f02-1cec-4708-9a74-c3c977313dfb to /dev/vdb
Nov 10 23:10:14 user nova-compute[75288]: DEBUG os_brick.utils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3893682a-f677-4c3e-82b3-978d1823d609]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b913a-b946-42e7-abd6-90f875654a65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac7cc3d-de29-4007-bd3f-27f641cec666]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae87f96-0282-46a8-bea1-68eadf6985f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:10:14 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:10:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b4cc2-e9fc-4948-8afc-3f39de5cb045]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG os_brick.utils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updating existing volume attachment record: 5d54996a-4d3d-42bd-a690-03f139c8d5e4 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:10:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "81873c5c-8554-4bbd-a80d-6498971c4382" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "81873c5c-8554-4bbd-a80d-6498971c4382" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:26 user nova-compute[75288]: INFO nova.compute.manager [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Terminating instance
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-3418ff4e-e38c-449e-bdff-a083e8469caf req-b5df8d95-8b26-4f4e-abd5-c71572e0634b service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received event network-vif-unplugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3418ff4e-e38c-449e-bdff-a083e8469caf req-b5df8d95-8b26-4f4e-abd5-c71572e0634b service nova] Acquiring lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3418ff4e-e38c-449e-bdff-a083e8469caf req-b5df8d95-8b26-4f4e-abd5-c71572e0634b service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3418ff4e-e38c-449e-bdff-a083e8469caf req-b5df8d95-8b26-4f4e-abd5-c71572e0634b service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-3418ff4e-e38c-449e-bdff-a083e8469caf req-b5df8d95-8b26-4f4e-abd5-c71572e0634b service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] No waiting events found dispatching network-vif-unplugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-3418ff4e-e38c-449e-bdff-a083e8469caf req-b5df8d95-8b26-4f4e-abd5-c71572e0634b service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received event network-vif-unplugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Instance destroyed successfully.
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'resources' on Instance uuid 81873c5c-8554-4bbd-a80d-6498971c4382 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-940443063',display_name='tempest-TestVolumeBootPattern-server-940443063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-940443063',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:09:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-cm3wjn4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:09:15Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=81873c5c-8554-4bbd-a80d-6498971c4382,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "address": "fa:16:3e:1e:5a:27", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bc5d0a8-44", "ovs_interfaceid": "2bc5d0a8-4492-43a9-9223-cc39a13e7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:27,bridge_name='br-int',has_traffic_filtering=True,id=2bc5d0a8-4492-43a9-9223-cc39a13e7a14,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bc5d0a8-44') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG os_vif [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:27,bridge_name='br-int',has_traffic_filtering=True,id=2bc5d0a8-4492-43a9-9223-cc39a13e7a14,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bc5d0a8-44') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bc5d0a8-44, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b167f9b-6784-4805-93ca-87130a3da3e7) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:26 user nova-compute[75288]: INFO os_vif [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:5a:27,bridge_name='br-int',has_traffic_filtering=True,id=2bc5d0a8-4492-43a9-9223-cc39a13e7a14,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bc5d0a8-44')
Nov 10 23:10:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATvrRsnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:10:26 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:10:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3c05e6-7bd4-49c4-a28c-76b9a5c46b68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:10:26 user nova-compute[75288]: No targets found.
Nov 10 23:10:26 user nova-compute[75288]: iSNS:
Nov 10 23:10:26 user nova-compute[75288]: No targets found.
Nov 10 23:10:26 user nova-compute[75288]: STATIC:
Nov 10 23:10:26 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b
Nov 10 23:10:26 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:10:26 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:10:26 user nova-compute[75288]: FIRMWARE:
Nov 10 23:10:26 user nova-compute[75288]: No targets found.
Nov 10 23:10:26 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:10:26 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:10:26 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42cd16a-d1c3-4dab-9624-0cbe00553231]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828d9e8-bfbf-4d00-addf-69bd9f98e00a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b (non-flash)
Nov 10 23:10:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b (non-flash)
Nov 10 23:10:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10339000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d135ea5c-c65c-4990-94b7-d0dece710f1a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad0832-dc5f-4fbc-b561-b136c5b0f39d]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1827710-aa47-4540-8064-4e7d238e97e5]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3c6d93-9017-458a-b5e3-7d265fc6706e]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f629b971-ef8e-447c-b4da-4a40ee51a475]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[92112212-2db6-4662-837b-e73673de65a9]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260]
Nov 10 23:10:27 user nova-compute[75288]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b, portal: 172.16.0.220,3260] successful.
Nov 10 23:10:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458e0aa2-f645-49de-b92f-7790a65d2e3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e4067-c110-4efd-b176-0d3858a27db8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== disconnect_volume: return (328ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:10:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Deleting instance files /opt/stack/data/nova/instances/81873c5c-8554-4bbd-a80d-6498971c4382_del
Nov 10 23:10:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Deletion of /opt/stack/data/nova/instances/81873c5c-8554-4bbd-a80d-6498971c4382_del complete
Nov 10 23:10:27 user nova-compute[75288]: INFO nova.compute.manager [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 10 23:10:27 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:10:27 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:10:27 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Took 0.53 seconds to deallocate network for instance.
Nov 10 23:10:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-459035ae-0730-45ee-871b-b38e6bb1adc2 req-bb55e7d4-ccd6-463d-86d0-878838431ada service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received event network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-459035ae-0730-45ee-871b-b38e6bb1adc2 req-bb55e7d4-ccd6-463d-86d0-878838431ada service nova] Acquiring lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-459035ae-0730-45ee-871b-b38e6bb1adc2 req-bb55e7d4-ccd6-463d-86d0-878838431ada service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-459035ae-0730-45ee-871b-b38e6bb1adc2 req-bb55e7d4-ccd6-463d-86d0-878838431ada service nova] Lock "81873c5c-8554-4bbd-a80d-6498971c4382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-459035ae-0730-45ee-871b-b38e6bb1adc2 req-bb55e7d4-ccd6-463d-86d0-878838431ada service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] No waiting events found dispatching network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:10:28 user nova-compute[75288]: WARNING nova.compute.manager [req-459035ae-0730-45ee-871b-b38e6bb1adc2 req-bb55e7d4-ccd6-463d-86d0-878838431ada service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received unexpected event network-vif-plugged-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 for instance with vm_state active and task_state deleting.
Nov 10 23:10:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-459035ae-0730-45ee-871b-b38e6bb1adc2 req-bb55e7d4-ccd6-463d-86d0-878838431ada service nova] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Received event network-vif-deleted-2bc5d0a8-4492-43a9-9223-cc39a13e7a14 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:10:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:39 user nova-compute[75288]: INFO nova.compute.manager [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Took 11.44 seconds to detach 1 volumes for instance.
Nov 10 23:10:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 81873c5c-8554-4bbd-a80d-6498971c4382] Deleting volume: 458e0aa2-f645-49de-b92f-7790a65d2e3b {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwYnEUqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:10:39 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:10:39 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:10:39 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03a0a09-8989-4b68-ae39-e882b08dd991]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:10:39 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ef60a-eadf-4a00-870e-eff7c981a7a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb] added
Nov 10 23:10:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[761fc4be-675d-4eb0-a0ce-f14e01a1af62]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5761649f-2561-4e3c-bf6e-d31e67b9e2a0]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwYnEUqD {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwYnEUqD" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24494da-e859-4fe5-9a77-eebfe669727a]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FwYnEUqD'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[72041f6e-0137-48b0-aa9e-2054444627f3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[49912089-551d-4f2f-a910-af95f1982500]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:10:39 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:10:39 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:10:39 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 23:10:39 user nova-compute[75288]: 
Nov 10 23:10:39 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Deleted allocations for instance 81873c5c-8554-4bbd-a80d-6498971c4382
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a509f6a-f536-437d-834e-707440fc05c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260]
Nov 10 23:10:39 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260] successful.
Nov 10 23:10:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e7e863-fd49-42e9-bb76-cf59639542b2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca178cee-fe3c-40bc-a545-60a68e69fa6a tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "81873c5c-8554-4bbd-a80d-6498971c4382" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.631s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8899be6-a460-4ffa-a0b0-447ad5574dcf]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb (non-flash)
Nov 10 23:10:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb (non-flash)
Nov 10 23:10:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc32469-787c-4e46-a928-ab03cfe23144]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwYnEUqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26632323539316137', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:10:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632323539316137', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:10:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:10:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 23:10:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:10:40 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 23:10:40 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:10:40 user nova-compute[75288]:   <serial>ef267f02-1cec-4708-9a74-c3c977313dfb</serial>
Nov 10 23:10:40 user nova-compute[75288]: </disk>
Nov 10 23:10:40 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 23:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No VIF found with MAC fa:16:3e:52:11:70, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:10:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f251c487-515e-42d4-8f49-6518967534fd tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.321s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:42 user nova-compute[75288]: INFO nova.compute.manager [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Detaching volume ef267f02-1cec-4708-9a74-c3c977313dfb
Nov 10 23:10:42 user nova-compute[75288]: INFO nova.virt.block_device [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Attempting to driver detach volume ef267f02-1cec-4708-9a74-c3c977313dfb from mountpoint /dev/vdb
Nov 10 23:10:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Attempting to detach device vdb from instance 450b0f72-f999-48da-80e7-9af78aa4840a from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 23:10:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:10:42 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:10:42 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 23:10:42 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:10:42 user nova-compute[75288]:   <serial>ef267f02-1cec-4708-9a74-c3c977313dfb</serial>
Nov 10 23:10:42 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:10:42 user nova-compute[75288]: </disk>
Nov 10 23:10:42 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:10:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully detached device vdb from instance 450b0f72-f999-48da-80e7-9af78aa4840a from the persistent domain config.
Nov 10 23:10:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 450b0f72-f999-48da-80e7-9af78aa4840a from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 23:10:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:10:42 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:10:42 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Nov 10 23:10:42 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:10:42 user nova-compute[75288]:   <serial>ef267f02-1cec-4708-9a74-c3c977313dfb</serial>
Nov 10 23:10:42 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:10:42 user nova-compute[75288]: </disk>
Nov 10 23:10:42 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:10:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:10:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:10:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=25.07613754272461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 450b0f72-f999-48da-80e7-9af78aa4840a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:10:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:10:45 user nova-compute[75288]: INFO nova.compute.claims [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Claim successful on node user
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:10:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.policy [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '668bc2c5df874686a40bd7db9e2ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142de0a2567d467a80099c49d749be32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:10:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Creating image(s)
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "/opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "/opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk 1073741824" returned: 0 in 0.057s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Successfully created port: 156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:10:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Cannot resize image /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Ensure instance console log exists: /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Successfully updated port: 156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquired lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-changed-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Refreshing instance network info cache due to event network-changed-156d4351-bcb9-4511-8e66-c1b50bbbf614. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] Acquiring lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:10:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating instance_info_cache with network_info: [{"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Releasing lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Instance network_info: |[{"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] Acquired lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Refreshing network info cache for port 156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Start _get_guest_xml network_info=[{"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:10:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:10:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1746526690',display_name='tempest-VolumesSnapshotTestJSON-instance-1746526690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1746526690',id=45,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7nrEcvARo21FiWzWkhCBaObApZulscSeddBfYKYPqg0dWKvjOS5OjvkfCpE7B+WFGPrp1ztsgaxZXEjaOE4cYCOQshE4UpVAenLslkVZJXo7+4c9+1+7yUBOE18jQXVw==',key_name='tempest-keypair-1399500268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142de0a2567d467a80099c49d749be32',ramdisk_id='',reservation_id='r-98wth22p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234690226',owner_user_name='tempest-VolumesSnapshotTestJSON-234690226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='668bc2c5df874686a40bd7db9e2ae448',uuid=fe4ddf18-a4c4-4654-b4b0-f533a7391ba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converting VIF {"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:23:34,bridge_name='br-int',has_traffic_filtering=True,id=156d4351-bcb9-4511-8e66-c1b50bbbf614,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156d4351-bc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'pci_devices' on Instance uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:10:48 user nova-compute[75288]:   <uuid>fe4ddf18-a4c4-4654-b4b0-f533a7391ba0</uuid>
Nov 10 23:10:48 user nova-compute[75288]:   <name>instance-0000002d</name>
Nov 10 23:10:48 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:10:48 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:10:48 user nova-compute[75288]:   <metadata>
Nov 10 23:10:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:10:48 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:10:48 user nova-compute[75288]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1746526690</nova:name>
Nov 10 23:10:48 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:10:48</nova:creationTime>
Nov 10 23:10:48 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:10:48 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:10:48 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:10:48 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:10:48 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:10:48 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:10:48 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:10:48 user nova-compute[75288]:       <nova:owner>
Nov 10 23:10:48 user nova-compute[75288]:         <nova:user uuid="668bc2c5df874686a40bd7db9e2ae448">tempest-VolumesSnapshotTestJSON-234690226-project-member</nova:user>
Nov 10 23:10:48 user nova-compute[75288]:         <nova:project uuid="142de0a2567d467a80099c49d749be32">tempest-VolumesSnapshotTestJSON-234690226</nova:project>
Nov 10 23:10:48 user nova-compute[75288]:       </nova:owner>
Nov 10 23:10:48 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 23:10:48 user nova-compute[75288]:       <nova:ports>
Nov 10 23:10:48 user nova-compute[75288]:         <nova:port uuid="156d4351-bcb9-4511-8e66-c1b50bbbf614">
Nov 10 23:10:48 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 23:10:48 user nova-compute[75288]:         </nova:port>
Nov 10 23:10:48 user nova-compute[75288]:       </nova:ports>
Nov 10 23:10:48 user nova-compute[75288]:     </nova:instance>
Nov 10 23:10:48 user nova-compute[75288]:   </metadata>
Nov 10 23:10:48 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:10:48 user nova-compute[75288]:     <system>
Nov 10 23:10:48 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:10:48 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:10:48 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:10:48 user nova-compute[75288]:       <entry name="serial">fe4ddf18-a4c4-4654-b4b0-f533a7391ba0</entry>
Nov 10 23:10:48 user nova-compute[75288]:       <entry name="uuid">fe4ddf18-a4c4-4654-b4b0-f533a7391ba0</entry>
Nov 10 23:10:48 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:10:48 user nova-compute[75288]:     </system>
Nov 10 23:10:48 user nova-compute[75288]:   </sysinfo>
Nov 10 23:10:48 user nova-compute[75288]:   <os>
Nov 10 23:10:48 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:10:48 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:10:48 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:10:48 user nova-compute[75288]:   </os>
Nov 10 23:10:48 user nova-compute[75288]:   <features>
Nov 10 23:10:48 user nova-compute[75288]:     <acpi/>
Nov 10 23:10:48 user nova-compute[75288]:     <apic/>
Nov 10 23:10:48 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:10:48 user nova-compute[75288]:   </features>
Nov 10 23:10:48 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:10:48 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:10:48 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:10:48 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:10:48 user nova-compute[75288]:   </clock>
Nov 10 23:10:48 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:10:48 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:10:48 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:10:48 user nova-compute[75288]:   </cpu>
Nov 10 23:10:48 user nova-compute[75288]:   <devices>
Nov 10 23:10:48 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:10:48 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:10:48 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk"/>
Nov 10 23:10:48 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:10:48 user nova-compute[75288]:     </disk>
Nov 10 23:10:48 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:10:48 user nova-compute[75288]:       <mac address="fa:16:3e:c9:23:34"/>
Nov 10 23:10:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:10:48 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:10:48 user nova-compute[75288]:       <target dev="tap156d4351-bc"/>
Nov 10 23:10:48 user nova-compute[75288]:     </interface>
Nov 10 23:10:48 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:10:48 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/console.log" append="off"/>
Nov 10 23:10:48 user nova-compute[75288]:     </serial>
Nov 10 23:10:48 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:10:48 user nova-compute[75288]:     <video>
Nov 10 23:10:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:10:48 user nova-compute[75288]:     </video>
Nov 10 23:10:48 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:10:48 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:10:48 user nova-compute[75288]:     </rng>
Nov 10 23:10:48 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:10:48 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:10:48 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:10:48 user nova-compute[75288]:     </memballoon>
Nov 10 23:10:48 user nova-compute[75288]:   </devices>
Nov 10 23:10:48 user nova-compute[75288]: </domain>
Nov 10 23:10:48 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1746526690',display_name='tempest-VolumesSnapshotTestJSON-instance-1746526690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1746526690',id=45,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7nrEcvARo21FiWzWkhCBaObApZulscSeddBfYKYPqg0dWKvjOS5OjvkfCpE7B+WFGPrp1ztsgaxZXEjaOE4cYCOQshE4UpVAenLslkVZJXo7+4c9+1+7yUBOE18jQXVw==',key_name='tempest-keypair-1399500268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142de0a2567d467a80099c49d749be32',ramdisk_id='',reservation_id='r-98wth22p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234690226',owner_user_name='tempest-VolumesSnapshotTestJSON-234690226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='668bc2c5df874686a40bd7db9e2ae448',uuid=fe4ddf18-a4c4-4654-b4b0-f533a7391ba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converting VIF {"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:23:34,bridge_name='br-int',has_traffic_filtering=True,id=156d4351-bcb9-4511-8e66-c1b50bbbf614,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156d4351-bc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG os_vif [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:23:34,bridge_name='br-int',has_traffic_filtering=True,id=156d4351-bcb9-4511-8e66-c1b50bbbf614,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156d4351-bc') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff106f92-17a8-5f81-b39d-f7c93c671721', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap156d4351-bc, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap156d4351-bc, col_values=(('qos', UUID('417d5550-2d26-4942-959b-18403335f02d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap156d4351-bc, col_values=(('external_ids', {'iface-id': '156d4351-bcb9-4511-8e66-c1b50bbbf614', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:23:34', 'vm-uuid': 'fe4ddf18-a4c4-4654-b4b0-f533a7391ba0'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:48 user nova-compute[75288]: INFO os_vif [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:23:34,bridge_name='br-int',has_traffic_filtering=True,id=156d4351-bcb9-4511-8e66-c1b50bbbf614,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156d4351-bc')
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No VIF found with MAC fa:16:3e:c9:23:34, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updated VIF entry in instance network info cache for port 156d4351-bcb9-4511-8e66-c1b50bbbf614. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating instance_info_cache with network_info: [{"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:10:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0d317d32-8f9f-4c51-a09c-a36a37eb4797 req-3c98cc75-ade4-4227-911d-39cb1c5c7097 service nova] Releasing lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-33daf208-8b7e-473d-9280-7b6cc2b05d3e req-de9a3ff5-61a9-4f1e-86a6-496306a12983 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-33daf208-8b7e-473d-9280-7b6cc2b05d3e req-de9a3ff5-61a9-4f1e-86a6-496306a12983 service nova] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-33daf208-8b7e-473d-9280-7b6cc2b05d3e req-de9a3ff5-61a9-4f1e-86a6-496306a12983 service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-33daf208-8b7e-473d-9280-7b6cc2b05d3e req-de9a3ff5-61a9-4f1e-86a6-496306a12983 service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-33daf208-8b7e-473d-9280-7b6cc2b05d3e req-de9a3ff5-61a9-4f1e-86a6-496306a12983 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] No waiting events found dispatching network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:10:49 user nova-compute[75288]: WARNING nova.compute.manager [req-33daf208-8b7e-473d-9280-7b6cc2b05d3e req-de9a3ff5-61a9-4f1e-86a6-496306a12983 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received unexpected event network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 for instance with vm_state building and task_state spawning.
Nov 10 23:10:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-0426d828-c692-4f35-86a1-1212d976b9eb req-e982590b-a38f-4fea-abb0-da5abf1b3a7f service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:10:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0426d828-c692-4f35-86a1-1212d976b9eb req-e982590b-a38f-4fea-abb0-da5abf1b3a7f service nova] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:10:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0426d828-c692-4f35-86a1-1212d976b9eb req-e982590b-a38f-4fea-abb0-da5abf1b3a7f service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:10:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0426d828-c692-4f35-86a1-1212d976b9eb req-e982590b-a38f-4fea-abb0-da5abf1b3a7f service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-0426d828-c692-4f35-86a1-1212d976b9eb req-e982590b-a38f-4fea-abb0-da5abf1b3a7f service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] No waiting events found dispatching network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:10:51 user nova-compute[75288]: WARNING nova.compute.manager [req-0426d828-c692-4f35-86a1-1212d976b9eb req-e982590b-a38f-4fea-abb0-da5abf1b3a7f service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received unexpected event network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 for instance with vm_state building and task_state spawning.
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:10:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Instance spawned successfully.
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:10:52 user nova-compute[75288]: INFO nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 10 23:10:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:10:52 user nova-compute[75288]: INFO nova.compute.manager [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Took 6.37 seconds to build instance.
Nov 10 23:10:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d64e9a66-e5fc-48f5-8e54-1498229f1241 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.467s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:10:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:10:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:10:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:10:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 23:11:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:03 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 450b0f72-f999-48da-80e7-9af78aa4840a is timed out.
Nov 10 23:11:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully detached device vdb from instance 450b0f72-f999-48da-80e7-9af78aa4840a from the live domain config.
Nov 10 23:11:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwYnEUqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:11:03 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4bcbc-857c-45e7-ae7f-5741209ba5fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:11:03 user nova-compute[75288]: No targets found.
Nov 10 23:11:03 user nova-compute[75288]: iSNS:
Nov 10 23:11:03 user nova-compute[75288]: No targets found.
Nov 10 23:11:03 user nova-compute[75288]: STATIC:
Nov 10 23:11:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb
Nov 10 23:11:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:11:03 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:11:03 user nova-compute[75288]: FIRMWARE:
Nov 10 23:11:03 user nova-compute[75288]: No targets found.
Nov 10 23:11:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:11:03 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:11:03 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2047117-87c4-4554-85be-7f07657f1e70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d75ad1b-a8ac-406b-a44e-6e6f8f15f013]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb (non-flash)
Nov 10 23:11:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb (non-flash)
Nov 10 23:11:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b107e2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58b5085-2316-499d-bf7f-a272ead47e07]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde6c6cd-af07-436a-8485-87e0f7a8cbf8]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3238191-12a9-4488-9671-6156b4b365ac]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed6816-4048-423a-867a-2d70a1870f7c]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a4a9a8-f7f4-445f-a802-979023de3402]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2db5fb7-485a-4037-93c9-cc03efd6e253]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260]
Nov 10 23:11:03 user nova-compute[75288]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb, portal: 172.16.0.220,3260] successful.
Nov 10 23:11:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef267f02-1cec-4708-9a74-c3c977313dfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd32b0-46a6-4fca-a3f8-542cd7e92f12]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== disconnect_volume: return (281ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:11:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:11:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:11:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c0f1bb50-7825-42e1-b2ad-c42b75afe09c tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.863s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 23:11:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 23:11:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance has had 5 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:33 user nova-compute[75288]: INFO nova.compute.manager [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Terminating instance
Nov 10 23:11:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-6e879974-150f-4a69-b402-6485c0d8ae73 req-0be155be-4d53-480c-b039-7536d6bc5c0a service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-unplugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e879974-150f-4a69-b402-6485c0d8ae73 req-0be155be-4d53-480c-b039-7536d6bc5c0a service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e879974-150f-4a69-b402-6485c0d8ae73 req-0be155be-4d53-480c-b039-7536d6bc5c0a service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e879974-150f-4a69-b402-6485c0d8ae73 req-0be155be-4d53-480c-b039-7536d6bc5c0a service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-6e879974-150f-4a69-b402-6485c0d8ae73 req-0be155be-4d53-480c-b039-7536d6bc5c0a service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-unplugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-6e879974-150f-4a69-b402-6485c0d8ae73 req-0be155be-4d53-480c-b039-7536d6bc5c0a service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-unplugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:11:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Instance destroyed successfully.
Nov 10 23:11:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'resources' on Instance uuid 450b0f72-f999-48da-80e7-9af78aa4840a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1701099630',display_name='tempest-AttachVolumeNegativeTest-server-1701099630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1701099630',id=43,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGet3uxpzhoxIv9X6sSfF2KmtMTl3zVMNhf/ygIOrGu1pTl/NNedhpCsaSeI1XDMJDbOtSVsbTMnSvU0G5iArEEPLflXFNDjvZvEKjWS4SEqKh5maJblQZDqbYSCq+/51g==',key_name='tempest-keypair-1868482537',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:08:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-vjsj4325',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=450b0f72-f999-48da-80e7-9af78aa4840a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "address": "fa:16:3e:52:11:70", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179ceef5-4d", "ovs_interfaceid": "179ceef5-4d78-4467-9236-b52b8e6a8d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:11:70,bridge_name='br-int',has_traffic_filtering=True,id=179ceef5-4d78-4467-9236-b52b8e6a8d91,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179ceef5-4d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG os_vif [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:11:70,bridge_name='br-int',has_traffic_filtering=True,id=179ceef5-4d78-4467-9236-b52b8e6a8d91,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179ceef5-4d') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap179ceef5-4d, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=229c8375-aaa0-4be5-8436-2995ec03761a) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:34 user nova-compute[75288]: INFO os_vif [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:11:70,bridge_name='br-int',has_traffic_filtering=True,id=179ceef5-4d78-4467-9236-b52b8e6a8d91,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179ceef5-4d')
Nov 10 23:11:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Deleting instance files /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a_del
Nov 10 23:11:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Deletion of /opt/stack/data/nova/instances/450b0f72-f999-48da-80e7-9af78aa4840a_del complete
Nov 10 23:11:34 user nova-compute[75288]: INFO nova.compute.manager [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 23:11:34 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:11:35 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Took 0.89 seconds to deallocate network for instance.
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-739c9d9d-5f64-412d-a32a-8e1f0c14c2a3 req-e4f3864e-72c3-42ed-b328-cb7c64f30e6c service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-deleted-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:35 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Deleted allocations for instance 450b0f72-f999-48da-80e7-9af78aa4840a
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-224b527d-6656-4a99-9eeb-6e85500103eb tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "450b0f72-f999-48da-80e7-9af78aa4840a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:11:35 user nova-compute[75288]: WARNING nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received unexpected event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with vm_state deleted and task_state None.
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:11:35 user nova-compute[75288]: WARNING nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received unexpected event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with vm_state deleted and task_state None.
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:11:35 user nova-compute[75288]: WARNING nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received unexpected event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with vm_state deleted and task_state None.
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-unplugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-unplugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:11:35 user nova-compute[75288]: WARNING nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received unexpected event network-vif-unplugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with vm_state deleted and task_state None.
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Acquiring lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] Lock "450b0f72-f999-48da-80e7-9af78aa4840a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] No waiting events found dispatching network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:11:35 user nova-compute[75288]: WARNING nova.compute.manager [req-a12309b9-8f4f-4cc1-ba7d-e5be14352504 req-201ac0f2-683b-45ce-bf34-a28f33d2b6fa service nova] [instance: 450b0f72-f999-48da-80e7-9af78aa4840a] Received unexpected event network-vif-plugged-179ceef5-4d78-4467-9236-b52b8e6a8d91 for instance with vm_state deleted and task_state None.
Nov 10 23:11:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:11:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:42 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:11:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:11:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:11:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:11:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.07369613647461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:11:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:11:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:11:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:11:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:11:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:11:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:11:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:11:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating instance_info_cache with network_info: [{"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:11:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:11:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:11:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:11:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:11:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:11:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:12:01 user nova-compute[75288]: INFO nova.compute.claims [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Claim successful on node user
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:12:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:12:01 user nova-compute[75288]: INFO nova.virt.block_device [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Booting with volume 8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 at /dev/vda
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.policy [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa19686e14744c0dbbd437aee915f870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2793e892931b4463b6f44fa9bf6da539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG os_brick.utils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e905e689-4118-445f-a1fb-11e0d1a882a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2cb8c9-0dd8-4d84-9400-104db4a05277]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6207fed-8ebf-44ca-96fe-520ca79c7695]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc918ca7-437c-401f-8f59-28da91297f58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:12:01 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:12:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bb282d-7b5b-4740-9527-701c1ff3dd7c]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG os_brick.utils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:12:01 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updating existing volume attachment record: 3c7e7098-3f3b-4bcd-a4db-b5b192c7cf3e {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:12:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Successfully created port: 53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Successfully updated port: 53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquired lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-changed-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Refreshing instance network info cache due to event network-changed-53da3e04-afbd-43eb-970c-f7e0f247989c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] Acquiring lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updating instance_info_cache with network_info: [{"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Releasing lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Instance network_info: |[{"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] Acquired lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.network.neutron [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Refreshing network info cache for port 53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.network.neutron [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updated VIF entry in instance network info cache for port 53da3e04-afbd-43eb-970c-f7e0f247989c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG nova.network.neutron [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updating instance_info_cache with network_info: [{"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:12:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-94dbc5cc-2f08-4c39-843f-2643da569b9b req-1ae1300d-c5cb-4506-943a-9dee8ebaca41 service nova] Releasing lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:12:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:12:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:12:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:12:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:12:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:12:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:12:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Creating image(s)
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Ensure instance console log exists: /opt/stack/data/nova/instances/aada61e3-4f47-4ee4-b6c7-32272672b2c2/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Start _get_guest_xml network_info=[{"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXSBqvKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aada61e3-4f47-4ee4-b6c7-32272672b2c2', 'attached_at': '', 'detached_at': '', 'volume_id': '8a3b6caf-dc80-4a67-a9e0-e3a2ef543168', 'serial': '8a3b6caf-dc80-4a67-a9e0-e3a2ef543168'}, 'mount_device': '/dev/vda', 'attachment_id': '3c7e7098-3f3b-4bcd-a4db-b5b192c7cf3e', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:12:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:12:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXSBqvKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:12:24 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:12:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:12:24 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:12:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:12:24 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[145fd03a-78e8-42c1-8307-0e5bc94bf091]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:12:24 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[701e8315-2bda-4ad6-aae0-61dd2800b1fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168] added
Nov 10 23:12:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc91eb-b040-43e5-b3df-7d0a2aa9c181]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc117863-cd50-4b28-8b75-3c5b9e36f00c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXSBqvKT {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXSBqvKT" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a330dd3-740e-4d3e-8c68-693f0c7dc495]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXSBqvKT'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45f7cd9-c33f-4885-9788-b9481957fb5b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0412ad8b-e48a-476e-a90b-46063003d5fe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:12:25 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:12:25 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:12:25 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 23:12:25 user nova-compute[75288]: 
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d543e4ce-5126-458e-807e-776ac52f7e85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260]
Nov 10 23:12:25 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260] successful.
Nov 10 23:12:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebadf7c-2bea-4167-9f1f-102676157539]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062c5be-cc43-40a6-98ef-908ea233de08]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:12:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:12:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d85f24-fe2a-4348-a5fe-2fb47b61f04f]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:12:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXSBqvKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23866623766376531', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866623766376531', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1643009741',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1643009741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1643009741',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8Q8za8+2v6LXRTI7SkMz6idlC54bFF01+ABjfjDseRet3lNpCoDJHWhYn9QHEZt0pUq/yyo7eF2Cdx2U5GUofLNFEW4J0Obl3Q4/vGZc08m/ZrCd0mkf8oL7lI9GOUcQ==',key_name='tempest-keypair-437910072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-d4hgmw75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19686e14744c0dbbd437aee915f870',uuid=aada61e3-4f47-4ee4-b6c7-32272672b2c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:41:0d,bridge_name='br-int',has_traffic_filtering=True,id=53da3e04-afbd-43eb-970c-f7e0f247989c,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53da3e04-af') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'pci_devices' on Instance uuid aada61e3-4f47-4ee4-b6c7-32272672b2c2 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:12:26 user nova-compute[75288]:   <uuid>aada61e3-4f47-4ee4-b6c7-32272672b2c2</uuid>
Nov 10 23:12:26 user nova-compute[75288]:   <name>instance-0000002e</name>
Nov 10 23:12:26 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:12:26 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:12:26 user nova-compute[75288]:   <metadata>
Nov 10 23:12:26 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:12:26 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:12:26 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1643009741</nova:name>
Nov 10 23:12:26 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:12:24</nova:creationTime>
Nov 10 23:12:26 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:12:26 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:12:26 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:12:26 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:12:26 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:12:26 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:12:26 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:12:26 user nova-compute[75288]:       <nova:owner>
Nov 10 23:12:26 user nova-compute[75288]:         <nova:user uuid="aa19686e14744c0dbbd437aee915f870">tempest-TestVolumeBootPattern-799029960-project-member</nova:user>
Nov 10 23:12:26 user nova-compute[75288]:         <nova:project uuid="2793e892931b4463b6f44fa9bf6da539">tempest-TestVolumeBootPattern-799029960</nova:project>
Nov 10 23:12:26 user nova-compute[75288]:       </nova:owner>
Nov 10 23:12:26 user nova-compute[75288]:       <nova:ports>
Nov 10 23:12:26 user nova-compute[75288]:         <nova:port uuid="53da3e04-afbd-43eb-970c-f7e0f247989c">
Nov 10 23:12:26 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 23:12:26 user nova-compute[75288]:         </nova:port>
Nov 10 23:12:26 user nova-compute[75288]:       </nova:ports>
Nov 10 23:12:26 user nova-compute[75288]:     </nova:instance>
Nov 10 23:12:26 user nova-compute[75288]:   </metadata>
Nov 10 23:12:26 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:12:26 user nova-compute[75288]:     <system>
Nov 10 23:12:26 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:12:26 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:12:26 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:12:26 user nova-compute[75288]:       <entry name="serial">aada61e3-4f47-4ee4-b6c7-32272672b2c2</entry>
Nov 10 23:12:26 user nova-compute[75288]:       <entry name="uuid">aada61e3-4f47-4ee4-b6c7-32272672b2c2</entry>
Nov 10 23:12:26 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:12:26 user nova-compute[75288]:     </system>
Nov 10 23:12:26 user nova-compute[75288]:   </sysinfo>
Nov 10 23:12:26 user nova-compute[75288]:   <os>
Nov 10 23:12:26 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:12:26 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:12:26 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:12:26 user nova-compute[75288]:   </os>
Nov 10 23:12:26 user nova-compute[75288]:   <features>
Nov 10 23:12:26 user nova-compute[75288]:     <acpi/>
Nov 10 23:12:26 user nova-compute[75288]:     <apic/>
Nov 10 23:12:26 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:12:26 user nova-compute[75288]:   </features>
Nov 10 23:12:26 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:12:26 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:12:26 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:12:26 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:12:26 user nova-compute[75288]:   </clock>
Nov 10 23:12:26 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:12:26 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:12:26 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:12:26 user nova-compute[75288]:   </cpu>
Nov 10 23:12:26 user nova-compute[75288]:   <devices>
Nov 10 23:12:26 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 23:12:26 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:12:26 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 23:12:26 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:12:26 user nova-compute[75288]:       <serial>8a3b6caf-dc80-4a67-a9e0-e3a2ef543168</serial>
Nov 10 23:12:26 user nova-compute[75288]:     </disk>
Nov 10 23:12:26 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:12:26 user nova-compute[75288]:       <mac address="fa:16:3e:01:41:0d"/>
Nov 10 23:12:26 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:12:26 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:12:26 user nova-compute[75288]:       <target dev="tap53da3e04-af"/>
Nov 10 23:12:26 user nova-compute[75288]:     </interface>
Nov 10 23:12:26 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:12:26 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/aada61e3-4f47-4ee4-b6c7-32272672b2c2/console.log" append="off"/>
Nov 10 23:12:26 user nova-compute[75288]:     </serial>
Nov 10 23:12:26 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:12:26 user nova-compute[75288]:     <video>
Nov 10 23:12:26 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:12:26 user nova-compute[75288]:     </video>
Nov 10 23:12:26 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:12:26 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:12:26 user nova-compute[75288]:     </rng>
Nov 10 23:12:26 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:12:26 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:12:26 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:12:26 user nova-compute[75288]:     </memballoon>
Nov 10 23:12:26 user nova-compute[75288]:   </devices>
Nov 10 23:12:26 user nova-compute[75288]: </domain>
Nov 10 23:12:26 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1643009741',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1643009741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1643009741',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8Q8za8+2v6LXRTI7SkMz6idlC54bFF01+ABjfjDseRet3lNpCoDJHWhYn9QHEZt0pUq/yyo7eF2Cdx2U5GUofLNFEW4J0Obl3Q4/vGZc08m/ZrCd0mkf8oL7lI9GOUcQ==',key_name='tempest-keypair-437910072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-d4hgmw75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19686e14744c0dbbd437aee915f870',uuid=aada61e3-4f47-4ee4-b6c7-32272672b2c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:41:0d,bridge_name='br-int',has_traffic_filtering=True,id=53da3e04-afbd-43eb-970c-f7e0f247989c,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53da3e04-af') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG os_vif [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:41:0d,bridge_name='br-int',has_traffic_filtering=True,id=53da3e04-afbd-43eb-970c-f7e0f247989c,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53da3e04-af') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c9a98b5-4563-5460-a92d-3d259a7f5783', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53da3e04-af, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53da3e04-af, col_values=(('qos', UUID('cc402bef-894f-4ca2-989a-8f0b7b00209c')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53da3e04-af, col_values=(('external_ids', {'iface-id': '53da3e04-afbd-43eb-970c-f7e0f247989c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:41:0d', 'vm-uuid': 'aada61e3-4f47-4ee4-b6c7-32272672b2c2'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:26 user nova-compute[75288]: INFO os_vif [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:41:0d,bridge_name='br-int',has_traffic_filtering=True,id=53da3e04-afbd-43eb-970c-f7e0f247989c,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53da3e04-af')
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No VIF found with MAC fa:16:3e:01:41:0d, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:12:27 user nova-compute[75288]: INFO nova.compute.claims [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Claim successful on node user
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:12:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.policy [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fd540ceafe84c2b877de1d038b28b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e470a0a6d2f74fad84a1f1f738e8383d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:12:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Creating image(s)
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "/opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "/opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-00f469d2-4272-48a3-836c-f4785eaddd39 req-d71d79ce-8ae4-457e-91b6-b5ff253d04ab service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00f469d2-4272-48a3-836c-f4785eaddd39 req-d71d79ce-8ae4-457e-91b6-b5ff253d04ab service nova] Acquiring lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00f469d2-4272-48a3-836c-f4785eaddd39 req-d71d79ce-8ae4-457e-91b6-b5ff253d04ab service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00f469d2-4272-48a3-836c-f4785eaddd39 req-d71d79ce-8ae4-457e-91b6-b5ff253d04ab service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-00f469d2-4272-48a3-836c-f4785eaddd39 req-d71d79ce-8ae4-457e-91b6-b5ff253d04ab service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] No waiting events found dispatching network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:12:27 user nova-compute[75288]: WARNING nova.compute.manager [req-00f469d2-4272-48a3-836c-f4785eaddd39 req-d71d79ce-8ae4-457e-91b6-b5ff253d04ab service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received unexpected event network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c for instance with vm_state building and task_state spawning.
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk 1073741824" returned: 0 in 0.062s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Successfully created port: 7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Cannot resize image /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Ensure instance console log exists: /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Successfully updated port: 7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquired lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-changed-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Refreshing instance network info cache due to event network-changed-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] Acquiring lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:12:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updating instance_info_cache with network_info: [{"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Releasing lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Instance network_info: |[{"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] Acquired lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Refreshing network info cache for port 7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Start _get_guest_xml network_info=[{"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:12:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:12:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-676477994',display_name='tempest-AttachVolumeNegativeTest-server-676477994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-676477994',id=47,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf730b0rS7Zwur0ps8VG6AXpF1E49CQDH4+sOC40Y+6afcVZoOxdLvHwFw413kQfTWpMRcJHXoePIh/AnXswn8diVhaTpW9lFEgOBZLCMwyy1mmptX2iaGdraU3uMueRw==',key_name='tempest-keypair-1581060170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-2w1tinfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=32d5758c-bd97-42e1-bfff-96e9bf31fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:29,bridge_name='br-int',has_traffic_filtering=True,id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f31fe0d-04') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'pci_devices' on Instance uuid 32d5758c-bd97-42e1-bfff-96e9bf31fc41 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:12:29 user nova-compute[75288]:   <uuid>32d5758c-bd97-42e1-bfff-96e9bf31fc41</uuid>
Nov 10 23:12:29 user nova-compute[75288]:   <name>instance-0000002f</name>
Nov 10 23:12:29 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:12:29 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:12:29 user nova-compute[75288]:   <metadata>
Nov 10 23:12:29 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:12:29 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:12:29 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-676477994</nova:name>
Nov 10 23:12:29 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:12:29</nova:creationTime>
Nov 10 23:12:29 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:12:29 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:12:29 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:12:29 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:12:29 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:12:29 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:12:29 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:12:29 user nova-compute[75288]:       <nova:owner>
Nov 10 23:12:29 user nova-compute[75288]:         <nova:user uuid="7fd540ceafe84c2b877de1d038b28b73">tempest-AttachVolumeNegativeTest-239737587-project-member</nova:user>
Nov 10 23:12:29 user nova-compute[75288]:         <nova:project uuid="e470a0a6d2f74fad84a1f1f738e8383d">tempest-AttachVolumeNegativeTest-239737587</nova:project>
Nov 10 23:12:29 user nova-compute[75288]:       </nova:owner>
Nov 10 23:12:29 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 23:12:29 user nova-compute[75288]:       <nova:ports>
Nov 10 23:12:29 user nova-compute[75288]:         <nova:port uuid="7f31fe0d-048b-4c4b-a448-0c5a9a691a1e">
Nov 10 23:12:29 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 23:12:29 user nova-compute[75288]:         </nova:port>
Nov 10 23:12:29 user nova-compute[75288]:       </nova:ports>
Nov 10 23:12:29 user nova-compute[75288]:     </nova:instance>
Nov 10 23:12:29 user nova-compute[75288]:   </metadata>
Nov 10 23:12:29 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:12:29 user nova-compute[75288]:     <system>
Nov 10 23:12:29 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:12:29 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:12:29 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:12:29 user nova-compute[75288]:       <entry name="serial">32d5758c-bd97-42e1-bfff-96e9bf31fc41</entry>
Nov 10 23:12:29 user nova-compute[75288]:       <entry name="uuid">32d5758c-bd97-42e1-bfff-96e9bf31fc41</entry>
Nov 10 23:12:29 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:12:29 user nova-compute[75288]:     </system>
Nov 10 23:12:29 user nova-compute[75288]:   </sysinfo>
Nov 10 23:12:29 user nova-compute[75288]:   <os>
Nov 10 23:12:29 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:12:29 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:12:29 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:12:29 user nova-compute[75288]:   </os>
Nov 10 23:12:29 user nova-compute[75288]:   <features>
Nov 10 23:12:29 user nova-compute[75288]:     <acpi/>
Nov 10 23:12:29 user nova-compute[75288]:     <apic/>
Nov 10 23:12:29 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:12:29 user nova-compute[75288]:   </features>
Nov 10 23:12:29 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:12:29 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:12:29 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:12:29 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:12:29 user nova-compute[75288]:   </clock>
Nov 10 23:12:29 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:12:29 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:12:29 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:12:29 user nova-compute[75288]:   </cpu>
Nov 10 23:12:29 user nova-compute[75288]:   <devices>
Nov 10 23:12:29 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:12:29 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:12:29 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk"/>
Nov 10 23:12:29 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:12:29 user nova-compute[75288]:     </disk>
Nov 10 23:12:29 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:12:29 user nova-compute[75288]:       <mac address="fa:16:3e:b0:8c:29"/>
Nov 10 23:12:29 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:12:29 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:12:29 user nova-compute[75288]:       <target dev="tap7f31fe0d-04"/>
Nov 10 23:12:29 user nova-compute[75288]:     </interface>
Nov 10 23:12:29 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:12:29 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/console.log" append="off"/>
Nov 10 23:12:29 user nova-compute[75288]:     </serial>
Nov 10 23:12:29 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:12:29 user nova-compute[75288]:     <video>
Nov 10 23:12:29 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:12:29 user nova-compute[75288]:     </video>
Nov 10 23:12:29 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:12:29 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:12:29 user nova-compute[75288]:     </rng>
Nov 10 23:12:29 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:12:29 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:12:29 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:12:29 user nova-compute[75288]:     </memballoon>
Nov 10 23:12:29 user nova-compute[75288]:   </devices>
Nov 10 23:12:29 user nova-compute[75288]: </domain>
Nov 10 23:12:29 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-676477994',display_name='tempest-AttachVolumeNegativeTest-server-676477994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-676477994',id=47,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf730b0rS7Zwur0ps8VG6AXpF1E49CQDH4+sOC40Y+6afcVZoOxdLvHwFw413kQfTWpMRcJHXoePIh/AnXswn8diVhaTpW9lFEgOBZLCMwyy1mmptX2iaGdraU3uMueRw==',key_name='tempest-keypair-1581060170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-2w1tinfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=32d5758c-bd97-42e1-bfff-96e9bf31fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:29,bridge_name='br-int',has_traffic_filtering=True,id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f31fe0d-04') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG os_vif [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:29,bridge_name='br-int',has_traffic_filtering=True,id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f31fe0d-04') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f9d5056-fc93-58d0-bc4b-1c30bc132fe0', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f31fe0d-04, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f31fe0d-04, col_values=(('qos', UUID('11e1a57d-f7e8-4599-8c93-869910caa171')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f31fe0d-04, col_values=(('external_ids', {'iface-id': '7f31fe0d-048b-4c4b-a448-0c5a9a691a1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8c:29', 'vm-uuid': '32d5758c-bd97-42e1-bfff-96e9bf31fc41'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: INFO os_vif [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8c:29,bridge_name='br-int',has_traffic_filtering=True,id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f31fe0d-04')
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No VIF found with MAC fa:16:3e:b0:8c:29, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updated VIF entry in instance network info cache for port 7f31fe0d-048b-4c4b-a448-0c5a9a691a1e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updating instance_info_cache with network_info: [{"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0cab501a-8936-4c79-9b07-d9da0a5a1cd3 req-f47089b2-2367-45b0-a265-54620f15988b service nova] Releasing lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-af680e05-9108-44c9-9844-27460996c3e2 req-1089ab96-d2a5-4689-8a9b-b0defd4ab049 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af680e05-9108-44c9-9844-27460996c3e2 req-1089ab96-d2a5-4689-8a9b-b0defd4ab049 service nova] Acquiring lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af680e05-9108-44c9-9844-27460996c3e2 req-1089ab96-d2a5-4689-8a9b-b0defd4ab049 service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af680e05-9108-44c9-9844-27460996c3e2 req-1089ab96-d2a5-4689-8a9b-b0defd4ab049 service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-af680e05-9108-44c9-9844-27460996c3e2 req-1089ab96-d2a5-4689-8a9b-b0defd4ab049 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] No waiting events found dispatching network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:12:29 user nova-compute[75288]: WARNING nova.compute.manager [req-af680e05-9108-44c9-9844-27460996c3e2 req-1089ab96-d2a5-4689-8a9b-b0defd4ab049 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received unexpected event network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c for instance with vm_state building and task_state spawning.
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:12:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Instance spawned successfully.
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:29 user nova-compute[75288]: INFO nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 10 23:12:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:12:29 user nova-compute[75288]: INFO nova.compute.manager [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Took 28.72 seconds to build instance.
Nov 10 23:12:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4fbf720-5e34-4d86-bb90-73f7c7320388 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.865s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-a245ba96-5ff9-4f00-96a4-757bfda5c9ef req-34412b52-9bae-45e9-ae35-6650c55c6320 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a245ba96-5ff9-4f00-96a4-757bfda5c9ef req-34412b52-9bae-45e9-ae35-6650c55c6320 service nova] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a245ba96-5ff9-4f00-96a4-757bfda5c9ef req-34412b52-9bae-45e9-ae35-6650c55c6320 service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a245ba96-5ff9-4f00-96a4-757bfda5c9ef req-34412b52-9bae-45e9-ae35-6650c55c6320 service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-a245ba96-5ff9-4f00-96a4-757bfda5c9ef req-34412b52-9bae-45e9-ae35-6650c55c6320 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] No waiting events found dispatching network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:12:30 user nova-compute[75288]: WARNING nova.compute.manager [req-a245ba96-5ff9-4f00-96a4-757bfda5c9ef req-34412b52-9bae-45e9-ae35-6650c55c6320 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received unexpected event network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e for instance with vm_state building and task_state spawning.
Nov 10 23:12:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:12:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Instance spawned successfully.
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:12:32 user nova-compute[75288]: INFO nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-993b59a1-e1a0-4600-9fd3-e4d7d878bc2a req-6710a327-11bb-4699-9ad5-08165ced15f2 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-993b59a1-e1a0-4600-9fd3-e4d7d878bc2a req-6710a327-11bb-4699-9ad5-08165ced15f2 service nova] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-993b59a1-e1a0-4600-9fd3-e4d7d878bc2a req-6710a327-11bb-4699-9ad5-08165ced15f2 service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-993b59a1-e1a0-4600-9fd3-e4d7d878bc2a req-6710a327-11bb-4699-9ad5-08165ced15f2 service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-993b59a1-e1a0-4600-9fd3-e4d7d878bc2a req-6710a327-11bb-4699-9ad5-08165ced15f2 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] No waiting events found dispatching network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:12:32 user nova-compute[75288]: WARNING nova.compute.manager [req-993b59a1-e1a0-4600-9fd3-e4d7d878bc2a req-6710a327-11bb-4699-9ad5-08165ced15f2 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received unexpected event network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e for instance with vm_state building and task_state spawning.
Nov 10 23:12:32 user nova-compute[75288]: INFO nova.compute.manager [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Took 6.00 seconds to build instance.
Nov 10 23:12:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc5e297e-261c-4464-883b-67edc6d12ad8 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.089s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-changed-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:12:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Refreshing instance network info cache due to event network-changed-156d4351-bcb9-4511-8e66-c1b50bbbf614. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:12:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] Acquiring lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:12:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] Acquired lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:12:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Refreshing network info cache for port 156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:12:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updated VIF entry in instance network info cache for port 156d4351-bcb9-4511-8e66-c1b50bbbf614. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:12:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating instance_info_cache with network_info: [{"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:12:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1714a333-8e64-4027-a422-86dc92e8333d req-32c27ba2-2740-4a64-a63f-a21051d3f671 service nova] Releasing lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'flavor' on Instance uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:12:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Ignoring supplied device name: /dev/vdb
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:38 user nova-compute[75288]: INFO nova.compute.manager [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Attaching volume ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 to /dev/vdb
Nov 10 23:12:38 user nova-compute[75288]: DEBUG os_brick.utils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[67980987-9ca7-48f7-a78b-737a3404d996]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf126191-7961-47f7-b3d8-ef6635ec6828]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3b81b9-57a0-463e-a4c2-2b0864461e28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cfeb00-a043-4d54-8a53-a41568c21d2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:12:38 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:12:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc88800-be9c-42be-b4e9-e815a171b534]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG os_brick.utils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:12:38 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating existing volume attachment record: e6723946-a590-4188-b4fc-6fa4d4e811a1 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:12:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:12:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:12:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:12:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:12:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8520MB free_disk=25.07033920288086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance aada61e3-4f47-4ee4-b6c7-32272672b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:12:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:12:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:12:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:12:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating instance_info_cache with network_info: [{"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:12:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:12:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:12:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:12:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:12:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:12:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdmQvCVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:13:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:13:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:13:02 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb96e2-dd41-4ebb-bda5-1967e8467f8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:13:02 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90d52fb-655b-4448-a7a9-145d319feae8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864] added
Nov 10 23:13:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4fed4-ee62-4b48-87ad-ae421906168b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ede8cf6-3668-4a23-b0b7-dc0301d62791]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tdmQvCVr {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tdmQvCVr" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62275e62-24ce-46a1-a90d-aed502f1312e]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tdmQvCVr'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd03d4c-8e7f-40ef-a6b3-17372184c615]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2745ea-4e4e-43c1-bd0a-ffc6ec50fffb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:13:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:13:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b333087-db44-4074-8ff6-329cb72b924d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260]
Nov 10 23:13:02 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260] successful.
Nov 10 23:13:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af0124-3ca9-4cad-bf73-2eb9110e12d8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[786a2b4e-92a6-439c-a576-e92de77f1adb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:13:02 user nova-compute[75288]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 (non-flash)
Nov 10 23:13:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:13:02 user nova-compute[75288]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 (non-flash)
Nov 10 23:13:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd836aab-0b58-4469-ab88-4439ce81c053]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:13:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdmQvCVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:13:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:13:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23564646666353531', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:13:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564646666353531', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:13:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'flavor' on Instance uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:13:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 23:13:03 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:13:03 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:13:03 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:13:03 user nova-compute[75288]:   <serial>ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864</serial>
Nov 10 23:13:03 user nova-compute[75288]: </disk>
Nov 10 23:13:03 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 23:13:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:13:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:13:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No VIF found with MAC fa:16:3e:c9:23:34, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:13:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c0be811-4312-453e-aead-3f30452c9881 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.139s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:13:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:13:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:13:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:13:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:13:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:13:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:13:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:13:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:13:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:13:45 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:13:45 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:13:45 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=25.033546447753906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance aada61e3-4f47-4ee4-b6c7-32272672b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:13:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:13:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:13:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:13:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updating instance_info_cache with network_info: [{"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:13:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-changed-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Refreshing instance network info cache due to event network-changed-53da3e04-afbd-43eb-970c-f7e0f247989c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] Acquiring lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] Acquired lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Refreshing network info cache for port 53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updated VIF entry in instance network info cache for port 53da3e04-afbd-43eb-970c-f7e0f247989c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updating instance_info_cache with network_info: [{"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:13:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9ee830cd-a824-42fc-a460-89be90522a65 req-44a03a3f-7069-47f7-9a45-cc7090d195e2 service nova] Releasing lock "refresh_cache-aada61e3-4f47-4ee4-b6c7-32272672b2c2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:13:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "d292fd3b-f523-45a8-b3fd-b37b1d1e6258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "d292fd3b-f523-45a8-b3fd-b37b1d1e6258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:14:08 user nova-compute[75288]: INFO nova.compute.claims [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Claim successful on node user
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:14:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:14:08 user nova-compute[75288]: INFO nova.virt.block_device [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Booting with volume snapshot 322410d5-2f25-48a5-8476-e8e6c8a39b55 at /dev/vda
Nov 10 23:14:08 user nova-compute[75288]: DEBUG nova.policy [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa19686e14744c0dbbd437aee915f870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2793e892931b4463b6f44fa9bf6da539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:14:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Successfully created port: 30951dcb-1ac0-440b-b40c-0d8aa9615ef2 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:14:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Successfully updated port: 30951dcb-1ac0-440b-b40c-0d8aa9615ef2 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "refresh_cache-d292fd3b-f523-45a8-b3fd-b37b1d1e6258" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquired lock "refresh_cache-d292fd3b-f523-45a8-b3fd-b37b1d1e6258" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Received event network-changed-30951dcb-1ac0-440b-b40c-0d8aa9615ef2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Refreshing instance network info cache due to event network-changed-30951dcb-1ac0-440b-b40c-0d8aa9615ef2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] Acquiring lock "refresh_cache-d292fd3b-f523-45a8-b3fd-b37b1d1e6258" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Updating instance_info_cache with network_info: [{"id": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "address": "fa:16:3e:c2:30:5c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30951dcb-1a", "ovs_interfaceid": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Releasing lock "refresh_cache-d292fd3b-f523-45a8-b3fd-b37b1d1e6258" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Instance network_info: |[{"id": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "address": "fa:16:3e:c2:30:5c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30951dcb-1a", "ovs_interfaceid": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] Acquired lock "refresh_cache-d292fd3b-f523-45a8-b3fd-b37b1d1e6258" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Refreshing network info cache for port 30951dcb-1ac0-440b-b40c-0d8aa9615ef2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Updated VIF entry in instance network info cache for port 30951dcb-1ac0-440b-b40c-0d8aa9615ef2. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:14:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Updating instance_info_cache with network_info: [{"id": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "address": "fa:16:3e:c2:30:5c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30951dcb-1a", "ovs_interfaceid": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:14:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9bbf4ec-35bb-4bb9-8764-c3bd197d0d68 req-3da0d2b3-13c0-46ed-b1a4-291eb442f87f service nova] Releasing lock "refresh_cache-d292fd3b-f523-45a8-b3fd-b37b1d1e6258" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:14:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:17 user nova-compute[75288]: INFO nova.compute.manager [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Detaching volume ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864
Nov 10 23:14:17 user nova-compute[75288]: INFO nova.virt.block_device [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Attempting to driver detach volume ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 from mountpoint /dev/vdb
Nov 10 23:14:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Attempting to detach device vdb from instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 23:14:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:14:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:14:17 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:14:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:14:17 user nova-compute[75288]:   <serial>ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864</serial>
Nov 10 23:14:17 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:14:17 user nova-compute[75288]: </disk>
Nov 10 23:14:17 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:14:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully detached device vdb from instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 from the persistent domain config.
Nov 10 23:14:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 23:14:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:14:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:14:17 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:14:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:14:17 user nova-compute[75288]:   <serial>ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864</serial>
Nov 10 23:14:17 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:14:17 user nova-compute[75288]: </disk>
Nov 10 23:14:17 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:14:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-changed-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:14:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Refreshing instance network info cache due to event network-changed-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] Acquiring lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] Acquired lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:14:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Refreshing network info cache for port 7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:14:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updated VIF entry in instance network info cache for port 7f31fe0d-048b-4c4b-a448-0c5a9a691a1e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updating instance_info_cache with network_info: [{"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c8d67a4a-b0df-4657-a32c-5ee81e2689a1 req-fff8a989-c9e4-475d-b97b-f16e5a7cb70c service nova] Releasing lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG os_brick.utils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db14d9e-021e-4edc-9dfb-f407e984c974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33de60b-d111-41bd-ba66-b66a53f385f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ca3f20-2734-4519-bc82-4a84d9fc3caf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0f9483-9caa-4da0-8916-de9e38f5752e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:14:19 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:14:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[03164949-6d02-4ae9-bbac-5e984048ed41]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG os_brick.utils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Updating existing volume attachment record: 98703898-89c7-4519-b6a5-32e434e02d92 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:14:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:24 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 32d5758c-bd97-42e1-bfff-96e9bf31fc41 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:14:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:25 user nova-compute[75288]: INFO nova.compute.manager [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Attaching volume 439da8de-c6e0-4f41-b0c1-aded76ed041c to /dev/vdb
Nov 10 23:14:25 user nova-compute[75288]: DEBUG os_brick.utils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c260b-6967-4434-af5f-f5812ca88211]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d31643-60ca-4002-b81a-82964f8fde53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3802049e-97e5-471b-9083-55ac18898ff0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9608937f-0a9e-44a2-a8a2-a36e6beceacf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:14:25 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:14:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f291c-cc93-4116-96f5-073a5c5dc310]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG os_brick.utils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:14:25 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updating existing volume attachment record: e94bfdee-0ea5-445c-aa38-dacaa6841562 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:14:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 is timed out.
Nov 10 23:14:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully detached device vdb from instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 from the live domain config.
Nov 10 23:14:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdmQvCVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:14:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ea154-8dbe-40de-8960-ba057918f017]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:14:38 user nova-compute[75288]: No targets found.
Nov 10 23:14:38 user nova-compute[75288]: iSNS:
Nov 10 23:14:38 user nova-compute[75288]: No targets found.
Nov 10 23:14:38 user nova-compute[75288]: STATIC:
Nov 10 23:14:38 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168
Nov 10 23:14:38 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:14:38 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:14:38 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864
Nov 10 23:14:38 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:14:38 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:14:38 user nova-compute[75288]: FIRMWARE:
Nov 10 23:14:38 user nova-compute[75288]: No targets found.
Nov 10 23:14:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:14:38 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:14:38 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e992b-cbf4-4996-b982-bf1c52cdc6d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a60f6ca-7504-428a-b9f9-b50a55ac03bc]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:38 user nova-compute[75288]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 (non-flash)
Nov 10 23:14:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:38 user nova-compute[75288]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 (non-flash)
Nov 10 23:14:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b107e0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80fee8b-35d4-4a1d-9c53-5069586e6e70]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f92283-b47d-4429-a8bc-599e843dde69]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[21509029-0ec6-4001-8c21-de411c288a40]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc2095a-c472-4850-90c0-a860fcb6e2f4]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec92445-ae91-4f56-a2e4-9c1f451c945f]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed882f66-6e40-4f0d-a159-6c994e0821ad]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260]
Nov 10 23:14:38 user nova-compute[75288]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864, portal: 172.16.0.220,3260] successful.
Nov 10 23:14:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b22071-5f0a-4b3a-ad9e-ba8572e637a1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== disconnect_volume: return (282ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:14:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'flavor' on Instance uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a64b9643-e96e-4299-ba74-3cf9b5c1e831 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.037s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.917s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:39 user nova-compute[75288]: INFO nova.compute.manager [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Terminating instance
Nov 10 23:14:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.volume.cinder [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Update attachment failed for attachment 98703898-89c7-4519-b6a5-32e434e02d92. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Traceback (most recent call last):
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     driver_block_device.attach_block_devices(
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     _log_and_attach(device)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/virt/block_device.py", line 819, in attach
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     super(DriverVolSnapshotBlockDevice, self).attach(
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     self._do_attach(context, instance, volume, volume_api,
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     self._volume_attach(context, volume, connector, instance,
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     connection_info = volume_api.attachment_update(
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     res = method(self, ctx, *args, **kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     with excutils.save_and_reraise_exception():
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     self.force_reraise()
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     raise self.value
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     return method.func(obj, *args, **kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     resp = self._update('/attachments/%s' % id, body)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     return self.request(url, method, **kwargs)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258]     raise exceptions.from_response(resp, body)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded)
Nov 10 23:14:39 user nova-compute[75288]: ERROR nova.compute.manager [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] 
Nov 10 23:14:39 user nova-compute[75288]: DEBUG nova.compute.claims [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Aborting claim: <nova.compute.claims.Claim object at 0x7f4b284247c0> {{(pid=75288) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-8fbb9f32-6e50-48e6-9e8e-90285380642f req-0e3ed621-ca21-4173-9ee8-03f48f510537 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-vif-unplugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8fbb9f32-6e50-48e6-9e8e-90285380642f req-0e3ed621-ca21-4173-9ee8-03f48f510537 service nova] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8fbb9f32-6e50-48e6-9e8e-90285380642f req-0e3ed621-ca21-4173-9ee8-03f48f510537 service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8fbb9f32-6e50-48e6-9e8e-90285380642f req-0e3ed621-ca21-4173-9ee8-03f48f510537 service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-8fbb9f32-6e50-48e6-9e8e-90285380642f req-0e3ed621-ca21-4173-9ee8-03f48f510537 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] No waiting events found dispatching network-vif-unplugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:14:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-8fbb9f32-6e50-48e6-9e8e-90285380642f req-0e3ed621-ca21-4173-9ee8-03f48f510537 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-vif-unplugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.282s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Build of instance d292fd3b-f523-45a8-b3fd-b37b1d1e6258 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded) {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.utils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Build of instance d292fd3b-f523-45a8-b3fd-b37b1d1e6258 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75288) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 23:14:40 user nova-compute[75288]: ERROR nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Build of instance d292fd3b-f523-45a8-b3fd-b37b1d1e6258 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded): nova.exception.BuildAbortException: Build of instance d292fd3b-f523-45a8-b3fd-b37b1d1e6258 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded)
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Unplugging VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1858535519',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1858535519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1858535519',id=48,image_ref='4417840f-f404-4fba-9e12-9fa9cbcaea1c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASTnVrurF9nGT3liUIoLfFioaw17gm3ncpPTov5Ik2BDnuvIfEd220NP0nSab2MguQboaKcMrVBeIb/Y1Uqbn9kPW8H4rE4cLZc5wdb66X2ZOIzSA8pVimaywoc5eJOKw==',key_name='tempest-keypair-1527039664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-4yxp0n0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-799029960',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19686e14744c0dbbd437aee915f870',uuid=d292fd3b-f523-45a8-b3fd-b37b1d1e6258,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "address": "fa:16:3e:c2:30:5c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30951dcb-1a", "ovs_interfaceid": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "address": "fa:16:3e:c2:30:5c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30951dcb-1a", "ovs_interfaceid": "30951dcb-1ac0-440b-b40c-0d8aa9615ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:30:5c,bridge_name='br-int',has_traffic_filtering=True,id=30951dcb-1ac0-440b-b40c-0d8aa9615ef2,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30951dcb-1a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_vif [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:30:5c,bridge_name='br-int',has_traffic_filtering=True,id=30951dcb-1ac0-440b-b40c-0d8aa9615ef2,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30951dcb-1a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30951dcb-1a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:14:40 user nova-compute[75288]: INFO os_vif [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:30:5c,bridge_name='br-int',has_traffic_filtering=True,id=30951dcb-1ac0-440b-b40c-0d8aa9615ef2,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30951dcb-1a')
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Unplugged VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:14:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Instance destroyed successfully.
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'resources' on Instance uuid fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1746526690',display_name='tempest-VolumesSnapshotTestJSON-instance-1746526690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1746526690',id=45,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7nrEcvARo21FiWzWkhCBaObApZulscSeddBfYKYPqg0dWKvjOS5OjvkfCpE7B+WFGPrp1ztsgaxZXEjaOE4cYCOQshE4UpVAenLslkVZJXo7+4c9+1+7yUBOE18jQXVw==',key_name='tempest-keypair-1399500268',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:10:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142de0a2567d467a80099c49d749be32',ramdisk_id='',reservation_id='r-98wth22p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-234690226',owner_user_name='tempest-VolumesSnapshotTestJSON-234690226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='668bc2c5df874686a40bd7db9e2ae448',uuid=fe4ddf18-a4c4-4654-b4b0-f533a7391ba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converting VIF {"id": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "address": "fa:16:3e:c9:23:34", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156d4351-bc", "ovs_interfaceid": "156d4351-bcb9-4511-8e66-c1b50bbbf614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:23:34,bridge_name='br-int',has_traffic_filtering=True,id=156d4351-bcb9-4511-8e66-c1b50bbbf614,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156d4351-bc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_vif [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:23:34,bridge_name='br-int',has_traffic_filtering=True,id=156d4351-bcb9-4511-8e66-c1b50bbbf614,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156d4351-bc') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap156d4351-bc, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=417d5550-2d26-4942-959b-18403335f02d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:14:40 user nova-compute[75288]: INFO os_vif [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:23:34,bridge_name='br-int',has_traffic_filtering=True,id=156d4351-bcb9-4511-8e66-c1b50bbbf614,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156d4351-bc')
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdmQvCVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:14:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8773f28-b41e-40d0-a06b-224ad05c5af7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:14:40 user nova-compute[75288]: No targets found.
Nov 10 23:14:40 user nova-compute[75288]: iSNS:
Nov 10 23:14:40 user nova-compute[75288]: No targets found.
Nov 10 23:14:40 user nova-compute[75288]: STATIC:
Nov 10 23:14:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168
Nov 10 23:14:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:14:40 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:14:40 user nova-compute[75288]: FIRMWARE:
Nov 10 23:14:40 user nova-compute[75288]: No targets found.
Nov 10 23:14:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:14:40 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:14:40 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4c3fd6-97ab-4d3a-9ee3-5aa1ae1ea864', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3bb7b4-ac1c-4a12-b4b9-538753e97353]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a84bf3a-ad5b-480e-8aa1-adfa9258552d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b20114f70>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== disconnect_volume: return (73ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:14:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Deleting instance files /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0_del
Nov 10 23:14:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Deletion of /opt/stack/data/nova/instances/fe4ddf18-a4c4-4654-b4b0-f533a7391ba0_del complete
Nov 10 23:14:40 user nova-compute[75288]: INFO nova.compute.manager [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 10 23:14:40 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:14:40 user nova-compute[75288]: INFO nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Took 0.48 seconds to deallocate network for instance.
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Detaching volume: 90454e01-c3c7-47dc-9da6-2f914f8d6396 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 23:14:40 user nova-compute[75288]: INFO nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Detaching volume 90454e01-c3c7-47dc-9da6-2f914f8d6396
Nov 10 23:14:40 user nova-compute[75288]: ERROR nova.virt.block_device [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Unable to call for a driver detach of volume 90454e01-c3c7-47dc-9da6-2f914f8d6396 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance d292fd3b-f523-45a8-b3fd-b37b1d1e6258 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2345b338-5362-4b50-bf2d-87502aaf8ded)
Nov 10 23:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: d292fd3b-f523-45a8-b3fd-b37b1d1e6258] Deleting volume: 90454e01-c3c7-47dc-9da6-2f914f8d6396 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 23:14:41 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Deleted allocations for instance d292fd3b-f523-45a8-b3fd-b37b1d1e6258
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-746c50f3-c556-487b-b584-28c231f3c825 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "d292fd3b-f523-45a8-b3fd-b37b1d1e6258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.967s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:14:41 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Took 0.71 seconds to deallocate network for instance.
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-4a30526c-32a1-4a8c-9cd1-85051aa8384e req-b4b00845-c2ff-4331-a53f-0fe29c03e58e service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-vif-deleted-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:14:41 user nova-compute[75288]: INFO nova.compute.manager [req-4a30526c-32a1-4a8c-9cd1-85051aa8384e req-b4b00845-c2ff-4331-a53f-0fe29c03e58e service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Neutron deleted interface 156d4351-bcb9-4511-8e66-c1b50bbbf614; detaching it from the instance and deleting it from the info cache
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-4a30526c-32a1-4a8c-9cd1-85051aa8384e req-b4b00845-c2ff-4331-a53f-0fe29c03e58e service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:14:41 user nova-compute[75288]: WARNING nova.volume.cinder [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Attachment e6723946-a590-4188-b4fc-6fa4d4e811a1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e6723946-a590-4188-b4fc-6fa4d4e811a1. (HTTP 404) (Request-ID: req-d53e12e9-24bd-459a-a73b-cbe075534c07)
Nov 10 23:14:41 user nova-compute[75288]: INFO nova.compute.manager [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-4a30526c-32a1-4a8c-9cd1-85051aa8384e req-b4b00845-c2ff-4331-a53f-0fe29c03e58e service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Detach interface failed, port_id=156d4351-bcb9-4511-8e66-c1b50bbbf614, reason: Instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:41 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Deleted allocations for instance fe4ddf18-a4c4-4654-b4b0-f533a7391ba0
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d10dcdd2-f86f-4848-a9cf-7293c20ae08b tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.103s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-64c26cfe-7c51-419b-abb2-497b722f3e2e req-a6dd212e-0af4-4ad6-a588-d417b2dff253 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received event network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64c26cfe-7c51-419b-abb2-497b722f3e2e req-a6dd212e-0af4-4ad6-a588-d417b2dff253 service nova] Acquiring lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64c26cfe-7c51-419b-abb2-497b722f3e2e req-a6dd212e-0af4-4ad6-a588-d417b2dff253 service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64c26cfe-7c51-419b-abb2-497b722f3e2e req-a6dd212e-0af4-4ad6-a588-d417b2dff253 service nova] Lock "fe4ddf18-a4c4-4654-b4b0-f533a7391ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-64c26cfe-7c51-419b-abb2-497b722f3e2e req-a6dd212e-0af4-4ad6-a588-d417b2dff253 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] No waiting events found dispatching network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:14:41 user nova-compute[75288]: WARNING nova.compute.manager [req-64c26cfe-7c51-419b-abb2-497b722f3e2e req-a6dd212e-0af4-4ad6-a588-d417b2dff253 service nova] [instance: fe4ddf18-a4c4-4654-b4b0-f533a7391ba0] Received unexpected event network-vif-plugged-156d4351-bcb9-4511-8e66-c1b50bbbf614 for instance with vm_state deleted and task_state None.
Nov 10 23:14:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:14:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:14:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:14:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.059112548828125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance aada61e3-4f47-4ee4-b6c7-32272672b2c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:14:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:14:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:14:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:14:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updating instance_info_cache with network_info: [{"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-32d5758c-bd97-42e1-bfff-96e9bf31fc41" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQJeVjfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:14:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:14:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:14:49 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[64874eb3-c4a2-4d9e-9e5c-8456cb25d85e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:14:49 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689d105-5a7a-4426-98b6-60a42a7cdc7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c] added
Nov 10 23:14:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4bb3f-1760-4b74-8670-61be7c7d7eda]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b503620-a281-438e-935f-8ae17bc9361c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQJeVjfu {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQJeVjfu" returned: 0 in 0.026s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c2c5cb-eafc-4eba-b3ed-24572de720a8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQJeVjfu'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cd1720-22df-4092-a2c6-002c853924a8]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf2f39-6172-4250-9bd7-22132aa9b326]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db411f2-9073-478f-82fd-30fb85f6d53e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260]
Nov 10 23:14:49 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260] successful.
Nov 10 23:14:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efdab66-1995-45fe-b57a-9881027f0148]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[851a4a01-4430-4960-8c0d-bb9d11c4c351]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:49 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)
Nov 10 23:14:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:14:49 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)
Nov 10 23:14:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b152a08-e96f-4439-8d32-07d3f30e7789]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:14:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQJeVjfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23031373131613135', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031373131613135', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 32d5758c-bd97-42e1-bfff-96e9bf31fc41 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:14:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 23:14:50 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:14:50 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:14:50 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:14:50 user nova-compute[75288]:   <serial>439da8de-c6e0-4f41-b0c1-aded76ed041c</serial>
Nov 10 23:14:50 user nova-compute[75288]: </disk>
Nov 10 23:14:50 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 23:14:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:14:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:14:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] No VIF found with MAC fa:16:3e:b0:8c:29, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:14:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c77dba56-21e0-4662-9bec-54c63c6f6fa3 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.245s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:14:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:14:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:14:52 user nova-compute[75288]: INFO nova.compute.manager [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Detaching volume 439da8de-c6e0-4f41-b0c1-aded76ed041c
Nov 10 23:14:52 user nova-compute[75288]: INFO nova.virt.block_device [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Attempting to driver detach volume 439da8de-c6e0-4f41-b0c1-aded76ed041c from mountpoint /dev/vdb
Nov 10 23:14:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Attempting to detach device vdb from instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 23:14:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:14:52 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:14:52 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:14:52 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:14:52 user nova-compute[75288]:   <serial>439da8de-c6e0-4f41-b0c1-aded76ed041c</serial>
Nov 10 23:14:52 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:14:52 user nova-compute[75288]: </disk>
Nov 10 23:14:52 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:14:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully detached device vdb from instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 from the persistent domain config.
Nov 10 23:14:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 23:14:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:14:52 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:14:52 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:14:52 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:14:52 user nova-compute[75288]:   <serial>439da8de-c6e0-4f41-b0c1-aded76ed041c</serial>
Nov 10 23:14:52 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:14:52 user nova-compute[75288]: </disk>
Nov 10 23:14:52 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:14:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 23:14:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:14:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:15:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:15:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:04 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:04 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:11 user nova-compute[75288]: INFO nova.compute.manager [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Terminating instance
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-46379e94-ceae-44a9-9298-1c7ac5baac28 req-ad669e50-af64-4659-8442-ab988fe9d3b2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-vif-unplugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46379e94-ceae-44a9-9298-1c7ac5baac28 req-ad669e50-af64-4659-8442-ab988fe9d3b2 service nova] Acquiring lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46379e94-ceae-44a9-9298-1c7ac5baac28 req-ad669e50-af64-4659-8442-ab988fe9d3b2 service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46379e94-ceae-44a9-9298-1c7ac5baac28 req-ad669e50-af64-4659-8442-ab988fe9d3b2 service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-46379e94-ceae-44a9-9298-1c7ac5baac28 req-ad669e50-af64-4659-8442-ab988fe9d3b2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] No waiting events found dispatching network-vif-unplugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-46379e94-ceae-44a9-9298-1c7ac5baac28 req-ad669e50-af64-4659-8442-ab988fe9d3b2 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-vif-unplugged-53da3e04-afbd-43eb-970c-f7e0f247989c for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:15:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Instance destroyed successfully.
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'resources' on Instance uuid aada61e3-4f47-4ee4-b6c7-32272672b2c2 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1643009741',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1643009741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1643009741',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8Q8za8+2v6LXRTI7SkMz6idlC54bFF01+ABjfjDseRet3lNpCoDJHWhYn9QHEZt0pUq/yyo7eF2Cdx2U5GUofLNFEW4J0Obl3Q4/vGZc08m/ZrCd0mkf8oL7lI9GOUcQ==',key_name='tempest-keypair-437910072',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:12:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-d4hgmw75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:12:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19686e14744c0dbbd437aee915f870',uuid=aada61e3-4f47-4ee4-b6c7-32272672b2c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "53da3e04-afbd-43eb-970c-f7e0f247989c", "address": "fa:16:3e:01:41:0d", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53da3e04-af", "ovs_interfaceid": "53da3e04-afbd-43eb-970c-f7e0f247989c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:41:0d,bridge_name='br-int',has_traffic_filtering=True,id=53da3e04-afbd-43eb-970c-f7e0f247989c,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53da3e04-af') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_vif [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:41:0d,bridge_name='br-int',has_traffic_filtering=True,id=53da3e04-afbd-43eb-970c-f7e0f247989c,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53da3e04-af') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53da3e04-af, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc402bef-894f-4ca2-989a-8f0b7b00209c) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:11 user nova-compute[75288]: INFO os_vif [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:41:0d,bridge_name='br-int',has_traffic_filtering=True,id=53da3e04-afbd-43eb-970c-f7e0f247989c,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53da3e04-af')
Nov 10 23:15:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXSBqvKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:15:11 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe7c6f6-882a-4787-9763-8301794acf0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:15:11 user nova-compute[75288]: No targets found.
Nov 10 23:15:11 user nova-compute[75288]: iSNS:
Nov 10 23:15:11 user nova-compute[75288]: No targets found.
Nov 10 23:15:11 user nova-compute[75288]: STATIC:
Nov 10 23:15:11 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168
Nov 10 23:15:11 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:15:11 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:15:11 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c
Nov 10 23:15:11 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:15:11 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:15:11 user nova-compute[75288]: FIRMWARE:
Nov 10 23:15:11 user nova-compute[75288]: No targets found.
Nov 10 23:15:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:15:11 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:15:11 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[61080f74-3b11-4c73-af73-c4ee18cdc649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d17c4d2-0302-4f37-acd5-fd5cf141ba3e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:15:11 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)
Nov 10 23:15:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 (non-flash)
Nov 10 23:15:12 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)
Nov 10 23:15:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10385090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e6075-2f57-4c58-89b1-cfc2348a8ab4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0640524-25e6-4c5e-86cd-ab20c6cc5b9d]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc810e-dfdb-40dd-bdfc-757d40088883]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[72615968-bfaf-4a5b-9cbe-395bd1598b6d]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23866623766376531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c285cb98', '/dev/disk/by-id/scsi-1SCST_BIOc285cb98-8fb7f7e108e03e5f') {{(pid=86709) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1298c-6336-4f61-8e3e-a707f351543d]: (4, None) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e966afcd-43fc-4ee3-b40f-d8d6fe8068f7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898e445-3fef-4106-9e30-8f86aa212704]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260]
Nov 10 23:15:12 user nova-compute[75288]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168, portal: 172.16.0.220,3260] successful.
Nov 10 23:15:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77abce49-8586-48bc-b9a0-93b32e1a88d2]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== disconnect_volume: return (298ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:15:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Deleting instance files /opt/stack/data/nova/instances/aada61e3-4f47-4ee4-b6c7-32272672b2c2_del
Nov 10 23:15:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Deletion of /opt/stack/data/nova/instances/aada61e3-4f47-4ee4-b6c7-32272672b2c2_del complete
Nov 10 23:15:12 user nova-compute[75288]: INFO nova.compute.manager [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 10 23:15:12 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:15:12 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:15:13 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Took 0.74 seconds to deallocate network for instance.
Nov 10 23:15:13 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 is timed out.
Nov 10 23:15:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully detached device vdb from instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 from the live domain config.
Nov 10 23:15:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQJeVjfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:15:13 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6615fec-e685-48af-97ff-d88e9c63f364]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:15:13 user nova-compute[75288]: No targets found.
Nov 10 23:15:13 user nova-compute[75288]: iSNS:
Nov 10 23:15:13 user nova-compute[75288]: No targets found.
Nov 10 23:15:13 user nova-compute[75288]: STATIC:
Nov 10 23:15:13 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c
Nov 10 23:15:13 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:15:13 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:15:13 user nova-compute[75288]: FIRMWARE:
Nov 10 23:15:13 user nova-compute[75288]: No targets found.
Nov 10 23:15:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:15:13 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:15:13 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04aa8c8-cf72-4b9c-b905-456f47ae7102]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad10eb9-8d86-45b9-bbca-16d6735a1e8d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)
Nov 10 23:15:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c (non-flash)
Nov 10 23:15:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10387c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c704a-402b-4288-9ed5-5f7a7eca312e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6668df-3c4d-4462-a387-ece85229541e]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eea0f62-f548-469f-b65b-809d7222f215]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[66060add-d3c1-4bf2-9161-ceacd460c603]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc382917-8801-47d4-b86e-7a68f1854341 req-afd6b3e0-7afc-462a-94b1-819b99a20c52 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc382917-8801-47d4-b86e-7a68f1854341 req-afd6b3e0-7afc-462a-94b1-819b99a20c52 service nova] Acquiring lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc382917-8801-47d4-b86e-7a68f1854341 req-afd6b3e0-7afc-462a-94b1-819b99a20c52 service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc382917-8801-47d4-b86e-7a68f1854341 req-afd6b3e0-7afc-462a-94b1-819b99a20c52 service nova] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc382917-8801-47d4-b86e-7a68f1854341 req-afd6b3e0-7afc-462a-94b1-819b99a20c52 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] No waiting events found dispatching network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:15:13 user nova-compute[75288]: WARNING nova.compute.manager [req-fc382917-8801-47d4-b86e-7a68f1854341 req-afd6b3e0-7afc-462a-94b1-819b99a20c52 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received unexpected event network-vif-plugged-53da3e04-afbd-43eb-970c-f7e0f247989c for instance with vm_state active and task_state deleting.
Nov 10 23:15:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc382917-8801-47d4-b86e-7a68f1854341 req-afd6b3e0-7afc-462a-94b1-819b99a20c52 service nova] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Received event network-vif-deleted-53da3e04-afbd-43eb-970c-f7e0f247989c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b9c11-7fd5-496a-99ea-25e5cd9ad37b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a24809-1420-4ce2-b16f-d830d4c8dda0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260]
Nov 10 23:15:13 user nova-compute[75288]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c, portal: 172.16.0.220,3260] successful.
Nov 10 23:15:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439da8de-c6e0-4f41-b0c1-aded76ed041c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b00275-750a-417e-8b5e-9a51983b06c7]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] <== disconnect_volume: return (335ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:15:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:15:14 user nova-compute[75288]: INFO nova.compute.manager [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Took 1.00 seconds to detach 1 volumes for instance.
Nov 10 23:15:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: aada61e3-4f47-4ee4-b6c7-32272672b2c2] Deleting volume: 8a3b6caf-dc80-4a67-a9e0-e3a2ef543168 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 23:15:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:15:14 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:15:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:14 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Deleted allocations for instance aada61e3-4f47-4ee4-b6c7-32272672b2c2
Nov 10 23:15:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0e9db4c-4627-47a5-95a1-1ff22fb76717 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "aada61e3-4f47-4ee4-b6c7-32272672b2c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.310s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'flavor' on Instance uuid 32d5758c-bd97-42e1-bfff-96e9bf31fc41 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:15:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ae7d16b-7560-46fb-b690-4dea4685ef40 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:15:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:15:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:43 user nova-compute[75288]: INFO nova.compute.manager [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Terminating instance
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-23ce2e7a-7c8c-492c-b128-11c170a34e3a req-f5142eb4-c127-4dcd-b2e7-cf25ba9d640a service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-vif-unplugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-23ce2e7a-7c8c-492c-b128-11c170a34e3a req-f5142eb4-c127-4dcd-b2e7-cf25ba9d640a service nova] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-23ce2e7a-7c8c-492c-b128-11c170a34e3a req-f5142eb4-c127-4dcd-b2e7-cf25ba9d640a service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-23ce2e7a-7c8c-492c-b128-11c170a34e3a req-f5142eb4-c127-4dcd-b2e7-cf25ba9d640a service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-23ce2e7a-7c8c-492c-b128-11c170a34e3a req-f5142eb4-c127-4dcd-b2e7-cf25ba9d640a service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] No waiting events found dispatching network-vif-unplugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-23ce2e7a-7c8c-492c-b128-11c170a34e3a req-f5142eb4-c127-4dcd-b2e7-cf25ba9d640a service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-vif-unplugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:15:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Instance destroyed successfully.
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lazy-loading 'resources' on Instance uuid 32d5758c-bd97-42e1-bfff-96e9bf31fc41 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-676477994',display_name='tempest-AttachVolumeNegativeTest-server-676477994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-676477994',id=47,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf730b0rS7Zwur0ps8VG6AXpF1E49CQDH4+sOC40Y+6afcVZoOxdLvHwFw413kQfTWpMRcJHXoePIh/AnXswn8diVhaTpW9lFEgOBZLCMwyy1mmptX2iaGdraU3uMueRw==',key_name='tempest-keypair-1581060170',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e470a0a6d2f74fad84a1f1f738e8383d',ramdisk_id='',reservation_id='r-2w1tinfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-239737587',owner_user_name='tempest-AttachVolumeNegativeTest-239737587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd540ceafe84c2b877de1d038b28b73',uuid=32d5758c-bd97-42e1-bfff-96e9bf31fc41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converting VIF {"id": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "address": "fa:16:3e:b0:8c:29", "network": {"id": "c7355563-2e19-4b6e-86e5-aa76bc1ba299", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1409027946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e470a0a6d2f74fad84a1f1f738e8383d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f31fe0d-04", "ovs_interfaceid": "7f31fe0d-048b-4c4b-a448-0c5a9a691a1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:29,bridge_name='br-int',has_traffic_filtering=True,id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f31fe0d-04') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG os_vif [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:29,bridge_name='br-int',has_traffic_filtering=True,id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f31fe0d-04') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f31fe0d-04, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11e1a57d-f7e8-4599-8c93-869910caa171) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:43 user nova-compute[75288]: INFO os_vif [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8c:29,bridge_name='br-int',has_traffic_filtering=True,id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e,network=Network(c7355563-2e19-4b6e-86e5-aa76bc1ba299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f31fe0d-04')
Nov 10 23:15:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Deleting instance files /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41_del
Nov 10 23:15:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Deletion of /opt/stack/data/nova/instances/32d5758c-bd97-42e1-bfff-96e9bf31fc41_del complete
Nov 10 23:15:43 user nova-compute[75288]: INFO nova.compute.manager [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 23:15:43 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:15:43 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:15:45 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Took 1.11 seconds to deallocate network for instance.
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-9389ef5c-ef22-4c72-b73a-10cc9bf5738d req-1cff6a4c-a8c1-42d1-8214-26b3e4548986 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-vif-deleted-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:15:45 user nova-compute[75288]: INFO nova.compute.manager [req-9389ef5c-ef22-4c72-b73a-10cc9bf5738d req-1cff6a4c-a8c1-42d1-8214-26b3e4548986 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Neutron deleted interface 7f31fe0d-048b-4c4b-a448-0c5a9a691a1e; detaching it from the instance and deleting it from the info cache
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.network.neutron [req-9389ef5c-ef22-4c72-b73a-10cc9bf5738d req-1cff6a4c-a8c1-42d1-8214-26b3e4548986 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-9389ef5c-ef22-4c72-b73a-10cc9bf5738d req-1cff6a4c-a8c1-42d1-8214-26b3e4548986 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Detach interface failed, port_id=7f31fe0d-048b-4c4b-a448-0c5a9a691a1e, reason: Instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:45 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Deleted allocations for instance 32d5758c-bd97-42e1-bfff-96e9bf31fc41
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-da543ff3-56d7-4b8f-85f6-b650180b98b4 req-091f8733-fe52-45a6-acfb-48d6a3fb4da4 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received event network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da543ff3-56d7-4b8f-85f6-b650180b98b4 req-091f8733-fe52-45a6-acfb-48d6a3fb4da4 service nova] Acquiring lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da543ff3-56d7-4b8f-85f6-b650180b98b4 req-091f8733-fe52-45a6-acfb-48d6a3fb4da4 service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da543ff3-56d7-4b8f-85f6-b650180b98b4 req-091f8733-fe52-45a6-acfb-48d6a3fb4da4 service nova] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-da543ff3-56d7-4b8f-85f6-b650180b98b4 req-091f8733-fe52-45a6-acfb-48d6a3fb4da4 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] No waiting events found dispatching network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:15:45 user nova-compute[75288]: WARNING nova.compute.manager [req-da543ff3-56d7-4b8f-85f6-b650180b98b4 req-091f8733-fe52-45a6-acfb-48d6a3fb4da4 service nova] [instance: 32d5758c-bd97-42e1-bfff-96e9bf31fc41] Received unexpected event network-vif-plugged-7f31fe0d-048b-4c4b-a448-0c5a9a691a1e for instance with vm_state deleted and task_state None.
Nov 10 23:15:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9746b91f-12de-4d7a-bb99-24a92a467650 tempest-AttachVolumeNegativeTest-239737587 tempest-AttachVolumeNegativeTest-239737587-project-member] Lock "32d5758c-bd97-42e1-bfff-96e9bf31fc41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.612s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:46 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:15:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:15:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:15:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=25.084941864013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:15:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:48 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:15:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:15:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:15:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:15:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:15:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:15:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:15:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:15:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:15:59 user nova-compute[75288]: INFO nova.compute.claims [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Claim successful on node user
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:15:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.policy [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '668bc2c5df874686a40bd7db9e2ae448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142de0a2567d467a80099c49d749be32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:15:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Creating image(s)
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "/opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "/opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:15:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec,backing_fmt=raw /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk 1073741824" returned: 0 in 0.051s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3e42f10bf8d49a60c6ba2db1b2346ea3fbaf1ec --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Successfully created port: 168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Cannot resize image /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Ensure instance console log exists: /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Successfully updated port: 168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquired lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-changed-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Refreshing instance network info cache due to event network-changed-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] Acquiring lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating instance_info_cache with network_info: [{"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Releasing lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Instance network_info: |[{"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] Acquired lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Refreshing network info cache for port 168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Start _get_guest_xml network_info=[{"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'image_id': 'f7c29f6c-dbb5-44ff-8be6-262881085121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:16:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:16:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T22:30:42Z,direct_url=<?>,disk_format='qcow2',id=f7c29f6c-dbb5-44ff-8be6-262881085121,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2049f10137ff459eb95071814d338e7c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T22:30:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1171807867',display_name='tempest-VolumesSnapshotTestJSON-instance-1171807867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1171807867',id=49,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZMWJ5ZMYC0wTq18MK4CX/A3OqZSMI2E1sRsJEZXcpF2OAKw8PAGFd5tT1cIlD/v7jSWXsvbI6Lj95YQ5hhaSh4SVB0iNZd1lCy3dwOIQB0gElvLH6uwBKBDRggO8OyPA==',key_name='tempest-keypair-1891725832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142de0a2567d467a80099c49d749be32',ramdisk_id='',reservation_id='r-onksiwg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234690226',owner_user_name='tempest-VolumesSnapshotTestJSON-234690226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='668bc2c5df874686a40bd7db9e2ae448',uuid=3ff16f2e-4472-4f9d-9b57-df9389db5c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converting VIF {"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:4d,bridge_name='br-int',has_traffic_filtering=True,id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168e61b3-bb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:16:01 user nova-compute[75288]:   <uuid>3ff16f2e-4472-4f9d-9b57-df9389db5c9c</uuid>
Nov 10 23:16:01 user nova-compute[75288]:   <name>instance-00000031</name>
Nov 10 23:16:01 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:16:01 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:16:01 user nova-compute[75288]:   <metadata>
Nov 10 23:16:01 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:16:01 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:16:01 user nova-compute[75288]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1171807867</nova:name>
Nov 10 23:16:01 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:16:01</nova:creationTime>
Nov 10 23:16:01 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:16:01 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:16:01 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:16:01 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:16:01 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:16:01 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:16:01 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:16:01 user nova-compute[75288]:       <nova:owner>
Nov 10 23:16:01 user nova-compute[75288]:         <nova:user uuid="668bc2c5df874686a40bd7db9e2ae448">tempest-VolumesSnapshotTestJSON-234690226-project-member</nova:user>
Nov 10 23:16:01 user nova-compute[75288]:         <nova:project uuid="142de0a2567d467a80099c49d749be32">tempest-VolumesSnapshotTestJSON-234690226</nova:project>
Nov 10 23:16:01 user nova-compute[75288]:       </nova:owner>
Nov 10 23:16:01 user nova-compute[75288]:       <nova:root type="image" uuid="f7c29f6c-dbb5-44ff-8be6-262881085121"/>
Nov 10 23:16:01 user nova-compute[75288]:       <nova:ports>
Nov 10 23:16:01 user nova-compute[75288]:         <nova:port uuid="168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8">
Nov 10 23:16:01 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 23:16:01 user nova-compute[75288]:         </nova:port>
Nov 10 23:16:01 user nova-compute[75288]:       </nova:ports>
Nov 10 23:16:01 user nova-compute[75288]:     </nova:instance>
Nov 10 23:16:01 user nova-compute[75288]:   </metadata>
Nov 10 23:16:01 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:16:01 user nova-compute[75288]:     <system>
Nov 10 23:16:01 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:16:01 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:16:01 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:16:01 user nova-compute[75288]:       <entry name="serial">3ff16f2e-4472-4f9d-9b57-df9389db5c9c</entry>
Nov 10 23:16:01 user nova-compute[75288]:       <entry name="uuid">3ff16f2e-4472-4f9d-9b57-df9389db5c9c</entry>
Nov 10 23:16:01 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:16:01 user nova-compute[75288]:     </system>
Nov 10 23:16:01 user nova-compute[75288]:   </sysinfo>
Nov 10 23:16:01 user nova-compute[75288]:   <os>
Nov 10 23:16:01 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:16:01 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:16:01 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:16:01 user nova-compute[75288]:   </os>
Nov 10 23:16:01 user nova-compute[75288]:   <features>
Nov 10 23:16:01 user nova-compute[75288]:     <acpi/>
Nov 10 23:16:01 user nova-compute[75288]:     <apic/>
Nov 10 23:16:01 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:16:01 user nova-compute[75288]:   </features>
Nov 10 23:16:01 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:16:01 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:16:01 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:16:01 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:16:01 user nova-compute[75288]:   </clock>
Nov 10 23:16:01 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:16:01 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:16:01 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:16:01 user nova-compute[75288]:   </cpu>
Nov 10 23:16:01 user nova-compute[75288]:   <devices>
Nov 10 23:16:01 user nova-compute[75288]:     <disk type="file" device="disk">
Nov 10 23:16:01 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 23:16:01 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk"/>
Nov 10 23:16:01 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:16:01 user nova-compute[75288]:     </disk>
Nov 10 23:16:01 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:16:01 user nova-compute[75288]:       <mac address="fa:16:3e:e6:ce:4d"/>
Nov 10 23:16:01 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:16:01 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:16:01 user nova-compute[75288]:       <target dev="tap168e61b3-bb"/>
Nov 10 23:16:01 user nova-compute[75288]:     </interface>
Nov 10 23:16:01 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:16:01 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/console.log" append="off"/>
Nov 10 23:16:01 user nova-compute[75288]:     </serial>
Nov 10 23:16:01 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:16:01 user nova-compute[75288]:     <video>
Nov 10 23:16:01 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:16:01 user nova-compute[75288]:     </video>
Nov 10 23:16:01 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:16:01 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:16:01 user nova-compute[75288]:     </rng>
Nov 10 23:16:01 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:16:01 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:16:01 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:16:01 user nova-compute[75288]:     </memballoon>
Nov 10 23:16:01 user nova-compute[75288]:   </devices>
Nov 10 23:16:01 user nova-compute[75288]: </domain>
Nov 10 23:16:01 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1171807867',display_name='tempest-VolumesSnapshotTestJSON-instance-1171807867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1171807867',id=49,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZMWJ5ZMYC0wTq18MK4CX/A3OqZSMI2E1sRsJEZXcpF2OAKw8PAGFd5tT1cIlD/v7jSWXsvbI6Lj95YQ5hhaSh4SVB0iNZd1lCy3dwOIQB0gElvLH6uwBKBDRggO8OyPA==',key_name='tempest-keypair-1891725832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142de0a2567d467a80099c49d749be32',ramdisk_id='',reservation_id='r-onksiwg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-234690226',owner_user_name='tempest-VolumesSnapshotTestJSON-234690226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='668bc2c5df874686a40bd7db9e2ae448',uuid=3ff16f2e-4472-4f9d-9b57-df9389db5c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converting VIF {"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:4d,bridge_name='br-int',has_traffic_filtering=True,id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168e61b3-bb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG os_vif [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:4d,bridge_name='br-int',has_traffic_filtering=True,id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168e61b3-bb') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a7d0940-914e-50d1-b764-836161cc9922', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap168e61b3-bb, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap168e61b3-bb, col_values=(('qos', UUID('61e5976c-39de-494b-b01f-84c953bf950c')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap168e61b3-bb, col_values=(('external_ids', {'iface-id': '168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ce:4d', 'vm-uuid': '3ff16f2e-4472-4f9d-9b57-df9389db5c9c'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:01 user nova-compute[75288]: INFO os_vif [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:4d,bridge_name='br-int',has_traffic_filtering=True,id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168e61b3-bb')
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No VIF found with MAC fa:16:3e:e6:ce:4d, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updated VIF entry in instance network info cache for port 168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating instance_info_cache with network_info: [{"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:16:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-22fc5537-73be-487e-b30c-9b5db01ba956 req-62ab99c5-4d7e-4117-b037-1256bea5e201 service nova] Releasing lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:16:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-3715cae6-ac14-4443-8878-fd8c799ae011 req-cf5c673b-de90-4586-812d-9259485721a8 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:16:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3715cae6-ac14-4443-8878-fd8c799ae011 req-cf5c673b-de90-4586-812d-9259485721a8 service nova] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3715cae6-ac14-4443-8878-fd8c799ae011 req-cf5c673b-de90-4586-812d-9259485721a8 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3715cae6-ac14-4443-8878-fd8c799ae011 req-cf5c673b-de90-4586-812d-9259485721a8 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-3715cae6-ac14-4443-8878-fd8c799ae011 req-cf5c673b-de90-4586-812d-9259485721a8 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] No waiting events found dispatching network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:16:03 user nova-compute[75288]: WARNING nova.compute.manager [req-3715cae6-ac14-4443-8878-fd8c799ae011 req-cf5c673b-de90-4586-812d-9259485721a8 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received unexpected event network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 for instance with vm_state building and task_state spawning.
Nov 10 23:16:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:16:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Instance spawned successfully.
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-298afcfc-e7b8-4c73-96e4-1b7148551243 req-b4e0ef7f-0de6-4f34-bd9d-d4b623b8ae73 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-298afcfc-e7b8-4c73-96e4-1b7148551243 req-b4e0ef7f-0de6-4f34-bd9d-d4b623b8ae73 service nova] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-298afcfc-e7b8-4c73-96e4-1b7148551243 req-b4e0ef7f-0de6-4f34-bd9d-d4b623b8ae73 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-298afcfc-e7b8-4c73-96e4-1b7148551243 req-b4e0ef7f-0de6-4f34-bd9d-d4b623b8ae73 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-298afcfc-e7b8-4c73-96e4-1b7148551243 req-b4e0ef7f-0de6-4f34-bd9d-d4b623b8ae73 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] No waiting events found dispatching network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:16:05 user nova-compute[75288]: WARNING nova.compute.manager [req-298afcfc-e7b8-4c73-96e4-1b7148551243 req-b4e0ef7f-0de6-4f34-bd9d-d4b623b8ae73 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received unexpected event network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 for instance with vm_state building and task_state spawning.
Nov 10 23:16:05 user nova-compute[75288]: INFO nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 10 23:16:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:16:05 user nova-compute[75288]: INFO nova.compute.manager [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Took 6.06 seconds to build instance.
Nov 10 23:16:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-77bf28f8-f8d8-48fd-9eda-dede78f0073a tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.167s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 23:16:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:10 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "076a913a-fede-4d5a-978e-e010f066f13d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "076a913a-fede-4d5a-978e-e010f066f13d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:16:22 user nova-compute[75288]: INFO nova.compute.claims [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Claim successful on node user
Nov 10 23:16:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:16:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:16:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG nova.policy [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa19686e14744c0dbbd437aee915f870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2793e892931b4463b6f44fa9bf6da539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:16:23 user nova-compute[75288]: INFO nova.virt.block_device [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Booting with volume 58ee8335-d6d1-4764-bcc7-8d8e6f153674 at /dev/vda
Nov 10 23:16:23 user nova-compute[75288]: DEBUG os_brick.utils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[06415d64-82d4-40f8-b54e-03d6c467be59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4bf37b-b8ce-41d6-ac84-c30feec56263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f8960-7fd6-43f1-a2ae-bdd6f4d386b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3337c-f142-44e5-93a1-dd02337677a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:16:23 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:16:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[936723e6-dcf4-4566-9f25-aa3c50f689f7]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG os_brick.utils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Updating existing volume attachment record: 067066ee-66ed-49fc-9582-f63ef81bdeb7 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Successfully created port: 33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Successfully updated port: 33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquired lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-changed-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Refreshing instance network info cache due to event network-changed-33080699-43aa-4c6e-aa4b-3dc07b9708ac. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] Acquiring lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Updating instance_info_cache with network_info: [{"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Releasing lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Instance network_info: |[{"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] Acquired lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:16:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Refreshing network info cache for port 33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:16:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Updated VIF entry in instance network info cache for port 33080699-43aa-4c6e-aa4b-3dc07b9708ac. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:16:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Updating instance_info_cache with network_info: [{"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:16:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-32e65902-4684-4752-adab-0182476c6db1 req-51a4601b-0337-4b6e-b400-ed37d61d2fc6 service nova] Releasing lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:16:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 23:16:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 23:16:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance has had 5 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 23:16:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:16:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Creating image(s)
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Ensure instance console log exists: /opt/stack/data/nova/instances/076a913a-fede-4d5a-978e-e010f066f13d/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Start _get_guest_xml network_info=[{"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '076a913a-fede-4d5a-978e-e010f066f13d', 'attached_at': '', 'detached_at': '', 'volume_id': '58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'serial': '58ee8335-d6d1-4764-bcc7-8d8e6f153674'}, 'mount_device': '/dev/vda', 'attachment_id': '067066ee-66ed-49fc-9582-f63ef81bdeb7', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:16:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:16:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:16:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:16:46 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:16:47 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:16:47 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e188e5-ffd7-405f-aa52-66ea81a4b412]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:16:47 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae462612-7d0b-4aeb-9578-aa0e271b115e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674] added
Nov 10 23:16:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f61f05-03b5-4b4f-96f4-985fc2121153]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d2c62-7113-4c05-9e1c-03cd88fe0f3c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeKVoLQU {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeKVoLQU" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a090e20d-66ee-473d-b927-ff4aa5515cdc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jeKVoLQU'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f3e4db-843c-4572-b7c6-c31052fe9c27]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0616f635-c233-4855-90a3-5d677ba77404]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:16:47 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 23:16:47 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:16:47 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 23:16:47 user nova-compute[75288]: 
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfef66c-d16e-4863-ab2c-de85e7af3442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]
Nov 10 23:16:47 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.
Nov 10 23:16:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcca50c-cc76-4669-bc21-e0323e4a31dd]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[453d0ba9-b67e-4bfa-a738-67bf713480b6]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:16:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:16:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[deed25a4-61e0-4408-a4a8-bf04b075fca2]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:16:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26162646462343763', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162646462343763', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:16:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:16:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8868MB free_disk=25.053810119628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-643473850',display_name='tempest-TestVolumeBootPattern-server-643473850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-643473850',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-1sx5mkgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:16:23Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=076a913a-fede-4d5a-978e-e010f066f13d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:50:a2,bridge_name='br-int',has_traffic_filtering=True,id=33080699-43aa-4c6e-aa4b-3dc07b9708ac,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33080699-43') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'pci_devices' on Instance uuid 076a913a-fede-4d5a-978e-e010f066f13d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:16:48 user nova-compute[75288]:   <uuid>076a913a-fede-4d5a-978e-e010f066f13d</uuid>
Nov 10 23:16:48 user nova-compute[75288]:   <name>instance-00000032</name>
Nov 10 23:16:48 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:16:48 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:16:48 user nova-compute[75288]:   <metadata>
Nov 10 23:16:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:16:48 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:16:48 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-643473850</nova:name>
Nov 10 23:16:48 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:16:46</nova:creationTime>
Nov 10 23:16:48 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:16:48 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:16:48 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:16:48 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:16:48 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:16:48 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:16:48 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:16:48 user nova-compute[75288]:       <nova:owner>
Nov 10 23:16:48 user nova-compute[75288]:         <nova:user uuid="aa19686e14744c0dbbd437aee915f870">tempest-TestVolumeBootPattern-799029960-project-member</nova:user>
Nov 10 23:16:48 user nova-compute[75288]:         <nova:project uuid="2793e892931b4463b6f44fa9bf6da539">tempest-TestVolumeBootPattern-799029960</nova:project>
Nov 10 23:16:48 user nova-compute[75288]:       </nova:owner>
Nov 10 23:16:48 user nova-compute[75288]:       <nova:ports>
Nov 10 23:16:48 user nova-compute[75288]:         <nova:port uuid="33080699-43aa-4c6e-aa4b-3dc07b9708ac">
Nov 10 23:16:48 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 23:16:48 user nova-compute[75288]:         </nova:port>
Nov 10 23:16:48 user nova-compute[75288]:       </nova:ports>
Nov 10 23:16:48 user nova-compute[75288]:     </nova:instance>
Nov 10 23:16:48 user nova-compute[75288]:   </metadata>
Nov 10 23:16:48 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:16:48 user nova-compute[75288]:     <system>
Nov 10 23:16:48 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:16:48 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:16:48 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:16:48 user nova-compute[75288]:       <entry name="serial">076a913a-fede-4d5a-978e-e010f066f13d</entry>
Nov 10 23:16:48 user nova-compute[75288]:       <entry name="uuid">076a913a-fede-4d5a-978e-e010f066f13d</entry>
Nov 10 23:16:48 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:16:48 user nova-compute[75288]:     </system>
Nov 10 23:16:48 user nova-compute[75288]:   </sysinfo>
Nov 10 23:16:48 user nova-compute[75288]:   <os>
Nov 10 23:16:48 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:16:48 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:16:48 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:16:48 user nova-compute[75288]:   </os>
Nov 10 23:16:48 user nova-compute[75288]:   <features>
Nov 10 23:16:48 user nova-compute[75288]:     <acpi/>
Nov 10 23:16:48 user nova-compute[75288]:     <apic/>
Nov 10 23:16:48 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:16:48 user nova-compute[75288]:   </features>
Nov 10 23:16:48 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:16:48 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:16:48 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:16:48 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:16:48 user nova-compute[75288]:   </clock>
Nov 10 23:16:48 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:16:48 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:16:48 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:16:48 user nova-compute[75288]:   </cpu>
Nov 10 23:16:48 user nova-compute[75288]:   <devices>
Nov 10 23:16:48 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 23:16:48 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:16:48 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 23:16:48 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:16:48 user nova-compute[75288]:       <serial>58ee8335-d6d1-4764-bcc7-8d8e6f153674</serial>
Nov 10 23:16:48 user nova-compute[75288]:     </disk>
Nov 10 23:16:48 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:16:48 user nova-compute[75288]:       <mac address="fa:16:3e:97:50:a2"/>
Nov 10 23:16:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:16:48 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:16:48 user nova-compute[75288]:       <target dev="tap33080699-43"/>
Nov 10 23:16:48 user nova-compute[75288]:     </interface>
Nov 10 23:16:48 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:16:48 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/076a913a-fede-4d5a-978e-e010f066f13d/console.log" append="off"/>
Nov 10 23:16:48 user nova-compute[75288]:     </serial>
Nov 10 23:16:48 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:16:48 user nova-compute[75288]:     <video>
Nov 10 23:16:48 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:16:48 user nova-compute[75288]:     </video>
Nov 10 23:16:48 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:16:48 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:16:48 user nova-compute[75288]:     </rng>
Nov 10 23:16:48 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:16:48 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:16:48 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:16:48 user nova-compute[75288]:     </memballoon>
Nov 10 23:16:48 user nova-compute[75288]:   </devices>
Nov 10 23:16:48 user nova-compute[75288]: </domain>
Nov 10 23:16:48 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-643473850',display_name='tempest-TestVolumeBootPattern-server-643473850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-643473850',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-1sx5mkgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:16:23Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=076a913a-fede-4d5a-978e-e010f066f13d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:50:a2,bridge_name='br-int',has_traffic_filtering=True,id=33080699-43aa-4c6e-aa4b-3dc07b9708ac,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33080699-43') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG os_vif [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:50:a2,bridge_name='br-int',has_traffic_filtering=True,id=33080699-43aa-4c6e-aa4b-3dc07b9708ac,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33080699-43') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e87fd6a0-7968-5ad6-8e3e-a401737accc5', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33080699-43, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33080699-43, col_values=(('qos', UUID('25454cad-1729-4250-acba-d6ebad3dd76e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33080699-43, col_values=(('external_ids', {'iface-id': '33080699-43aa-4c6e-aa4b-3dc07b9708ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:50:a2', 'vm-uuid': '076a913a-fede-4d5a-978e-e010f066f13d'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:16:48 user nova-compute[75288]: INFO os_vif [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:50:a2,bridge_name='br-int',has_traffic_filtering=True,id=33080699-43aa-4c6e-aa4b-3dc07b9708ac,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33080699-43')
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 076a913a-fede-4d5a-978e-e010f066f13d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No VIF found with MAC fa:16:3e:97:50:a2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:16:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Skipping network cache update for instance because it is Building. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:16:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-5527d92e-4af4-4a6a-b4a4-61000ae16775 req-454839c1-bcff-40f5-9c69-f25848f612da service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5527d92e-4af4-4a6a-b4a4-61000ae16775 req-454839c1-bcff-40f5-9c69-f25848f612da service nova] Acquiring lock "076a913a-fede-4d5a-978e-e010f066f13d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5527d92e-4af4-4a6a-b4a4-61000ae16775 req-454839c1-bcff-40f5-9c69-f25848f612da service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5527d92e-4af4-4a6a-b4a4-61000ae16775 req-454839c1-bcff-40f5-9c69-f25848f612da service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-5527d92e-4af4-4a6a-b4a4-61000ae16775 req-454839c1-bcff-40f5-9c69-f25848f612da service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] No waiting events found dispatching network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:16:50 user nova-compute[75288]: WARNING nova.compute.manager [req-5527d92e-4af4-4a6a-b4a4-61000ae16775 req-454839c1-bcff-40f5-9c69-f25848f612da service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received unexpected event network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac for instance with vm_state building and task_state spawning.
Nov 10 23:16:50 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating instance_info_cache with network_info: [{"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:16:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Instance spawned successfully.
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b811fd2-32a3-4299-b0b1-25c0e1711f30 req-65216acd-79b5-45b4-9f77-2be7cc2ee3e1 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b811fd2-32a3-4299-b0b1-25c0e1711f30 req-65216acd-79b5-45b4-9f77-2be7cc2ee3e1 service nova] Acquiring lock "076a913a-fede-4d5a-978e-e010f066f13d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b811fd2-32a3-4299-b0b1-25c0e1711f30 req-65216acd-79b5-45b4-9f77-2be7cc2ee3e1 service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b811fd2-32a3-4299-b0b1-25c0e1711f30 req-65216acd-79b5-45b4-9f77-2be7cc2ee3e1 service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b811fd2-32a3-4299-b0b1-25c0e1711f30 req-65216acd-79b5-45b4-9f77-2be7cc2ee3e1 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] No waiting events found dispatching network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:16:52 user nova-compute[75288]: WARNING nova.compute.manager [req-4b811fd2-32a3-4299-b0b1-25c0e1711f30 req-65216acd-79b5-45b4-9f77-2be7cc2ee3e1 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received unexpected event network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac for instance with vm_state building and task_state spawning.
Nov 10 23:16:52 user nova-compute[75288]: INFO nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 10 23:16:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:16:52 user nova-compute[75288]: INFO nova.compute.manager [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Took 29.75 seconds to build instance.
Nov 10 23:16:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed5898a7-3f74-4a96-bcbd-716ae12fb3e5 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "076a913a-fede-4d5a-978e-e010f066f13d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.854s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:16:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:16:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:16:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:17:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:17:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:17:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:17:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:17:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:17:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:17:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:17:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:17:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:17:49 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:17:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-changed-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Refreshing instance network info cache due to event network-changed-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] Acquiring lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] Acquired lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Refreshing network info cache for port 168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:17:50 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:17:50 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.043472290039062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'flavor' on Instance uuid 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:17:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Ignoring supplied device name: /dev/vdb
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 076a913a-fede-4d5a-978e-e010f066f13d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:17:50 user nova-compute[75288]: INFO nova.compute.manager [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Attaching volume 2bf0327f-1bda-47e1-8bfb-5d80b6afbebc to /dev/vdb
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG os_brick.utils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a300e64e-7867-4e41-b4fc-3ef3c4ff6722]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a42abf-e235-408f-a5b4-09c3b815b272]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[540272cb-6f6d-44ee-8687-2012f19b28fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf898d-0b1d-4a18-b7be-8fd6acfddcc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:17:51 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:17:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8590c08e-7f6a-418e-8b7b-d518d7b5057b]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG os_brick.utils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating existing volume attachment record: 8cd346f8-99d7-4bb6-abfb-af146d57b42b {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updated VIF entry in instance network info cache for port 168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating instance_info_cache with network_info: [{"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6987d30-ecb5-4bb6-ab2c-6990c2e60c6d req-04584067-7793-49ee-bc33-2d944e7d3c78 service nova] Releasing lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:17:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating instance_info_cache with network_info: [{"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-3ff16f2e-4472-4f9d-9b57-df9389db5c9c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:17:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:17:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:17:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:17:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:18:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-changed-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Refreshing instance network info cache due to event network-changed-33080699-43aa-4c6e-aa4b-3dc07b9708ac. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] Acquiring lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] Acquired lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Refreshing network info cache for port 33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIWaVCXe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:18:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:18:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:18:15 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[456d3165-9d68-41f4-9058-1f46f17bb11e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:18:15 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3d30d3-d9ba-4888-b389-a651ba37a88f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc] added
Nov 10 23:18:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c670ad36-fe71-4806-96ba-9fcffa906be1]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a762107e-cd49-4a96-b8ef-b0ed517f15fc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIWaVCXe {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIWaVCXe" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026ffc0-50b2-4515-93d9-c700f2c39677]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OIWaVCXe'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[291a303d-a6b7-4a43-9be6-994bd879bfbb]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae80ef2-7439-489d-bbf7-116229982a99]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:18:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:18:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[607ae8ab-62c9-4a46-b548-8c2462806da2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260]
Nov 10 23:18:15 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260] successful.
Nov 10 23:18:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d853e-bd79-433f-b22a-803af2695853]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f683f9-54dd-473f-b8a4-7d6ec053ab5f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:18:15 user nova-compute[75288]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:18:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:18:15 user nova-compute[75288]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:18:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432e362-44e5-4825-a713-3cb25cd2d170]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIWaVCXe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "076a913a-fede-4d5a-978e-e010f066f13d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "076a913a-fede-4d5a-978e-e010f066f13d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "076a913a-fede-4d5a-978e-e010f066f13d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:15 user nova-compute[75288]: INFO nova.compute.manager [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Terminating instance
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Updated VIF entry in instance network info cache for port 33080699-43aa-4c6e-aa4b-3dc07b9708ac. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Updating instance_info_cache with network_info: [{"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-74bc9d86-e553-4b19-a655-1504282a60aa req-6dbaa430-61ff-487e-b07f-64adfeb93a65 service nova] Releasing lock "refresh_cache-076a913a-fede-4d5a-978e-e010f066f13d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8952029b-55bf-4d1d-9f25-9b91fa69430e req-8582e41e-4361-4a43-91d1-40165ff35b60 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-vif-unplugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8952029b-55bf-4d1d-9f25-9b91fa69430e req-8582e41e-4361-4a43-91d1-40165ff35b60 service nova] Acquiring lock "076a913a-fede-4d5a-978e-e010f066f13d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8952029b-55bf-4d1d-9f25-9b91fa69430e req-8582e41e-4361-4a43-91d1-40165ff35b60 service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8952029b-55bf-4d1d-9f25-9b91fa69430e req-8582e41e-4361-4a43-91d1-40165ff35b60 service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8952029b-55bf-4d1d-9f25-9b91fa69430e req-8582e41e-4361-4a43-91d1-40165ff35b60 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] No waiting events found dispatching network-vif-unplugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:18:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8952029b-55bf-4d1d-9f25-9b91fa69430e req-8582e41e-4361-4a43-91d1-40165ff35b60 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-vif-unplugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:18:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Instance destroyed successfully.
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'resources' on Instance uuid 076a913a-fede-4d5a-978e-e010f066f13d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-643473850',display_name='tempest-TestVolumeBootPattern-server-643473850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-643473850',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-1sx5mkgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:16:52Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=076a913a-fede-4d5a-978e-e010f066f13d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "address": "fa:16:3e:97:50:a2", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33080699-43", "ovs_interfaceid": "33080699-43aa-4c6e-aa4b-3dc07b9708ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:50:a2,bridge_name='br-int',has_traffic_filtering=True,id=33080699-43aa-4c6e-aa4b-3dc07b9708ac,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33080699-43') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_vif [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:50:a2,bridge_name='br-int',has_traffic_filtering=True,id=33080699-43aa-4c6e-aa4b-3dc07b9708ac,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33080699-43') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33080699-43, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25454cad-1729-4250-acba-d6ebad3dd76e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:16 user nova-compute[75288]: INFO os_vif [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:50:a2,bridge_name='br-int',has_traffic_filtering=True,id=33080699-43aa-4c6e-aa4b-3dc07b9708ac,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33080699-43')
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:18:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23365366564376131', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365366564376131', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.186s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'flavor' on Instance uuid 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f875f-88cb-4c02-8b36-1c395d3dcf81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:18:16 user nova-compute[75288]: No targets found.
Nov 10 23:18:16 user nova-compute[75288]: iSNS:
Nov 10 23:18:16 user nova-compute[75288]: No targets found.
Nov 10 23:18:16 user nova-compute[75288]: STATIC:
Nov 10 23:18:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674
Nov 10 23:18:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:18:16 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:18:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc
Nov 10 23:18:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:18:16 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:18:16 user nova-compute[75288]: FIRMWARE:
Nov 10 23:18:16 user nova-compute[75288]: No targets found.
Nov 10 23:18:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:18:16 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:18:16 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 23:18:16 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:18:16 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:18:16 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:18:16 user nova-compute[75288]:   <serial>2bf0327f-1bda-47e1-8bfb-5d80b6afbebc</serial>
Nov 10 23:18:16 user nova-compute[75288]: </disk>
Nov 10 23:18:16 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697cba8-aa4e-4917-a797-6bc7f4e2ed7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3933aa5e-a4ec-4bb9-a429-de2d49e81a7d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:18:16 user nova-compute[75288]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:18:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:18:16 user nova-compute[75288]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:18:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10356c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1db8b0-5437-44f2-b784-0302bd7da09e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6875cdfe-d4f8-4651-bc3a-0316fcb28883]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b79fb1c-a4cb-4cf3-99f6-55016f2ea9fc]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[713d3fb4-2cd6-4637-bcee-a8eed6ec31e8]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a4f526-5786-4d6a-ab89-4eb6880777ac]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd3230-2c28-469a-899e-e2b87c2482ea]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]
Nov 10 23:18:16 user nova-compute[75288]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.
Nov 10 23:18:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f5b66-231c-465b-a111-b2cfa0c0d46c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== disconnect_volume: return (487ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:18:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Deleting instance files /opt/stack/data/nova/instances/076a913a-fede-4d5a-978e-e010f066f13d_del
Nov 10 23:18:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Deletion of /opt/stack/data/nova/instances/076a913a-fede-4d5a-978e-e010f066f13d_del complete
Nov 10 23:18:17 user nova-compute[75288]: INFO nova.compute.manager [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 10 23:18:17 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] No VIF found with MAC fa:16:3e:e6:ce:4d, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:18:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dd3c6fb2-ad04-48e4-897d-87b0d471cf0f tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.554s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-20a6eedc-5538-4880-8e16-92e972c56963 req-a545268d-e1bc-4708-96ef-ed231fc9ae31 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:18:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-20a6eedc-5538-4880-8e16-92e972c56963 req-a545268d-e1bc-4708-96ef-ed231fc9ae31 service nova] Acquiring lock "076a913a-fede-4d5a-978e-e010f066f13d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:18:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-20a6eedc-5538-4880-8e16-92e972c56963 req-a545268d-e1bc-4708-96ef-ed231fc9ae31 service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:18:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-20a6eedc-5538-4880-8e16-92e972c56963 req-a545268d-e1bc-4708-96ef-ed231fc9ae31 service nova] Lock "076a913a-fede-4d5a-978e-e010f066f13d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-20a6eedc-5538-4880-8e16-92e972c56963 req-a545268d-e1bc-4708-96ef-ed231fc9ae31 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] No waiting events found dispatching network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:18:18 user nova-compute[75288]: WARNING nova.compute.manager [req-20a6eedc-5538-4880-8e16-92e972c56963 req-a545268d-e1bc-4708-96ef-ed231fc9ae31 service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received unexpected event network-vif-plugged-33080699-43aa-4c6e-aa4b-3dc07b9708ac for instance with vm_state active and task_state deleting.
Nov 10 23:18:18 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:18:18 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Took 0.86 seconds to deallocate network for instance.
Nov 10 23:18:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-c83ca61b-8105-4f8e-b8e2-83cf0752e57c req-f335d9d6-e526-477e-bc8e-fd72075240ce service nova] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Received event network-vif-deleted-33080699-43aa-4c6e-aa4b-3dc07b9708ac {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:18:19 user nova-compute[75288]: INFO nova.compute.manager [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 076a913a-fede-4d5a-978e-e010f066f13d] Took 1.08 seconds to detach 1 volumes for instance.
Nov 10 23:18:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:18:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:18:19 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:18:19 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:18:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:19 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Deleted allocations for instance 076a913a-fede-4d5a-978e-e010f066f13d
Nov 10 23:18:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-31654d31-5738-4db2-be4d-1eab87015214 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "076a913a-fede-4d5a-978e-e010f066f13d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.739s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:18:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:18:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:51 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:18:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:18:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:18:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.041187286376953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:18:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:18:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:18:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:18:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:18:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:18:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:18:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:18:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:18:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:18:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:19:02 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:19:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:19:08 user nova-compute[75288]: INFO nova.compute.claims [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Claim successful on node user
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:19:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG nova.policy [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa19686e14744c0dbbd437aee915f870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2793e892931b4463b6f44fa9bf6da539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:19:08 user nova-compute[75288]: INFO nova.virt.block_device [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Booting with volume 58ee8335-d6d1-4764-bcc7-8d8e6f153674 at /dev/vda
Nov 10 23:19:08 user nova-compute[75288]: DEBUG os_brick.utils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b697827-3f0d-4e82-969c-8b6820fbb4f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e2bdb-91eb-4b8e-8f55-4f5e9bd4adc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4b9308-6d1f-4ca9-8c9d-4a95fb7d9119]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[102072ca-e380-4355-acac-83014346ceba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:19:09 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df14304-d41c-4aa4-ad0d-5f428a649c3c]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG os_brick.utils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating existing volume attachment record: 376936a4-41d7-49a1-8015-39baca293bda {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Successfully created port: e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Successfully updated port: e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-changed-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Refreshing instance network info cache due to event network-changed-e734cd63-eb70-4202-81c4-9d93a89b840d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:19:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Instance network_info: |[{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Refreshing network info cache for port e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updated VIF entry in instance network info cache for port e734cd63-eb70-4202-81c4-9d93a89b840d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:19:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3ea814e0-2c57-404e-834f-d31f7f2e3c19 req-fa17cbf8-ce8e-40a3-a75f-66d74151e847 service nova] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:19:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:18 user nova-compute[75288]: INFO nova.compute.manager [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Detaching volume 2bf0327f-1bda-47e1-8bfb-5d80b6afbebc
Nov 10 23:19:18 user nova-compute[75288]: INFO nova.virt.block_device [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Attempting to driver detach volume 2bf0327f-1bda-47e1-8bfb-5d80b6afbebc from mountpoint /dev/vdb
Nov 10 23:19:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Attempting to detach device vdb from instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 23:19:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:19:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:19:18 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:19:18 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:19:18 user nova-compute[75288]:   <serial>2bf0327f-1bda-47e1-8bfb-5d80b6afbebc</serial>
Nov 10 23:19:18 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:19:18 user nova-compute[75288]: </disk>
Nov 10 23:19:18 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:19:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully detached device vdb from instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c from the persistent domain config.
Nov 10 23:19:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 23:19:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 23:19:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:19:18 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Nov 10 23:19:18 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Nov 10 23:19:18 user nova-compute[75288]:   <serial>2bf0327f-1bda-47e1-8bfb-5d80b6afbebc</serial>
Nov 10 23:19:18 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 23:19:18 user nova-compute[75288]: </disk>
Nov 10 23:19:18 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 23:19:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 23:19:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:19:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Creating image(s)
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Ensure instance console log exists: /opt/stack/data/nova/instances/4c800323-9afa-4bc7-bce1-58a254ea01fd/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Start _get_guest_xml network_info=[{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c800323-9afa-4bc7-bce1-58a254ea01fd', 'attached_at': '', 'detached_at': '', 'volume_id': '58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'serial': '58ee8335-d6d1-4764-bcc7-8d8e6f153674'}, 'mount_device': '/dev/vda', 'attachment_id': '376936a4-41d7-49a1-8015-39baca293bda', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:19:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:19:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:19:33 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:19:33 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:19:33 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c1e1f-f269-4318-9315-93871e44fbf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:19:33 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b6ebd9-5d33-4da9-8eba-2bec4bb33c25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674] added
Nov 10 23:19:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0974f8e8-643a-4758-aa1a-199f7c4a76bf]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05e84c7-774e-4ffe-be6f-e97df98b7679]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeKVoLQU {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeKVoLQU" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1605b7-5960-4519-92b4-25d3923e8617]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jeKVoLQU'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f657c581-a6bf-4240-be96-1da7b4040be6]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc536784-4dd4-4fbb-a108-a99b8212b970]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:19:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:19:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b986bb4-09b8-4b84-928f-3f776ad88568]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]
Nov 10 23:19:33 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.
Nov 10 23:19:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[933c16bb-c220-4e92-826b-65e7c2eedd7b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd20491-b0a6-4d25-ab8a-1083944798a8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:19:33 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:19:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:19:33 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:19:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[391aeb78-dbb6-439c-89b0-c258d0114abc]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:19:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26162646462343763', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162646462343763', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-635496987',display_name='tempest-TestVolumeBootPattern-server-635496987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-635496987',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-pa22k44j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:19:09Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=4c800323-9afa-4bc7-bce1-58a254ea01fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=e734cd63-eb70-4202-81c4-9d93a89b840d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape734cd63-eb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c800323-9afa-4bc7-bce1-58a254ea01fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:19:34 user nova-compute[75288]:   <uuid>4c800323-9afa-4bc7-bce1-58a254ea01fd</uuid>
Nov 10 23:19:34 user nova-compute[75288]:   <name>instance-00000033</name>
Nov 10 23:19:34 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:19:34 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:19:34 user nova-compute[75288]:   <metadata>
Nov 10 23:19:34 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:19:34 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:19:34 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-635496987</nova:name>
Nov 10 23:19:34 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:19:33</nova:creationTime>
Nov 10 23:19:34 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:19:34 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:19:34 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:19:34 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:19:34 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:19:34 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:19:34 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:19:34 user nova-compute[75288]:       <nova:owner>
Nov 10 23:19:34 user nova-compute[75288]:         <nova:user uuid="aa19686e14744c0dbbd437aee915f870">tempest-TestVolumeBootPattern-799029960-project-member</nova:user>
Nov 10 23:19:34 user nova-compute[75288]:         <nova:project uuid="2793e892931b4463b6f44fa9bf6da539">tempest-TestVolumeBootPattern-799029960</nova:project>
Nov 10 23:19:34 user nova-compute[75288]:       </nova:owner>
Nov 10 23:19:34 user nova-compute[75288]:       <nova:ports>
Nov 10 23:19:34 user nova-compute[75288]:         <nova:port uuid="e734cd63-eb70-4202-81c4-9d93a89b840d">
Nov 10 23:19:34 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 23:19:34 user nova-compute[75288]:         </nova:port>
Nov 10 23:19:34 user nova-compute[75288]:       </nova:ports>
Nov 10 23:19:34 user nova-compute[75288]:     </nova:instance>
Nov 10 23:19:34 user nova-compute[75288]:   </metadata>
Nov 10 23:19:34 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:19:34 user nova-compute[75288]:     <system>
Nov 10 23:19:34 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:19:34 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:19:34 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:19:34 user nova-compute[75288]:       <entry name="serial">4c800323-9afa-4bc7-bce1-58a254ea01fd</entry>
Nov 10 23:19:34 user nova-compute[75288]:       <entry name="uuid">4c800323-9afa-4bc7-bce1-58a254ea01fd</entry>
Nov 10 23:19:34 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:19:34 user nova-compute[75288]:     </system>
Nov 10 23:19:34 user nova-compute[75288]:   </sysinfo>
Nov 10 23:19:34 user nova-compute[75288]:   <os>
Nov 10 23:19:34 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:19:34 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:19:34 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:19:34 user nova-compute[75288]:   </os>
Nov 10 23:19:34 user nova-compute[75288]:   <features>
Nov 10 23:19:34 user nova-compute[75288]:     <acpi/>
Nov 10 23:19:34 user nova-compute[75288]:     <apic/>
Nov 10 23:19:34 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:19:34 user nova-compute[75288]:   </features>
Nov 10 23:19:34 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:19:34 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:19:34 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:19:34 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:19:34 user nova-compute[75288]:   </clock>
Nov 10 23:19:34 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:19:34 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:19:34 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:19:34 user nova-compute[75288]:   </cpu>
Nov 10 23:19:34 user nova-compute[75288]:   <devices>
Nov 10 23:19:34 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 23:19:34 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:19:34 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Nov 10 23:19:34 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:19:34 user nova-compute[75288]:       <serial>58ee8335-d6d1-4764-bcc7-8d8e6f153674</serial>
Nov 10 23:19:34 user nova-compute[75288]:     </disk>
Nov 10 23:19:34 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:19:34 user nova-compute[75288]:       <mac address="fa:16:3e:a5:ca:73"/>
Nov 10 23:19:34 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:19:34 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:19:34 user nova-compute[75288]:       <target dev="tape734cd63-eb"/>
Nov 10 23:19:34 user nova-compute[75288]:     </interface>
Nov 10 23:19:34 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:19:34 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/4c800323-9afa-4bc7-bce1-58a254ea01fd/console.log" append="off"/>
Nov 10 23:19:34 user nova-compute[75288]:     </serial>
Nov 10 23:19:34 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:19:34 user nova-compute[75288]:     <video>
Nov 10 23:19:34 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:19:34 user nova-compute[75288]:     </video>
Nov 10 23:19:34 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:19:34 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:19:34 user nova-compute[75288]:     </rng>
Nov 10 23:19:34 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:19:34 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:19:34 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:19:34 user nova-compute[75288]:     </memballoon>
Nov 10 23:19:34 user nova-compute[75288]:   </devices>
Nov 10 23:19:34 user nova-compute[75288]: </domain>
Nov 10 23:19:34 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-635496987',display_name='tempest-TestVolumeBootPattern-server-635496987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-635496987',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-pa22k44j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:19:09Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=4c800323-9afa-4bc7-bce1-58a254ea01fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=e734cd63-eb70-4202-81c4-9d93a89b840d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape734cd63-eb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG os_vif [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=e734cd63-eb70-4202-81c4-9d93a89b840d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape734cd63-eb') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85ba329d-9068-58e1-97ab-91b22b52e725', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape734cd63-eb, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape734cd63-eb, col_values=(('qos', UUID('bf9ee5f9-7698-40b7-922c-595434a657fd')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape734cd63-eb, col_values=(('external_ids', {'iface-id': 'e734cd63-eb70-4202-81c4-9d93a89b840d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:ca:73', 'vm-uuid': '4c800323-9afa-4bc7-bce1-58a254ea01fd'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:34 user nova-compute[75288]: INFO os_vif [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=e734cd63-eb70-4202-81c4-9d93a89b840d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape734cd63-eb')
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:19:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No VIF found with MAC fa:16:3e:a5:ca:73, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-b27a9b8d-0310-47fe-997c-89cce7d14370 req-acd89dd7-de86-44f9-b4da-41102f90b3e2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b27a9b8d-0310-47fe-997c-89cce7d14370 req-acd89dd7-de86-44f9-b4da-41102f90b3e2 service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b27a9b8d-0310-47fe-997c-89cce7d14370 req-acd89dd7-de86-44f9-b4da-41102f90b3e2 service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b27a9b8d-0310-47fe-997c-89cce7d14370 req-acd89dd7-de86-44f9-b4da-41102f90b3e2 service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-b27a9b8d-0310-47fe-997c-89cce7d14370 req-acd89dd7-de86-44f9-b4da-41102f90b3e2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:19:36 user nova-compute[75288]: WARNING nova.compute.manager [req-b27a9b8d-0310-47fe-997c-89cce7d14370 req-acd89dd7-de86-44f9-b4da-41102f90b3e2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received unexpected event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with vm_state building and task_state spawning.
Nov 10 23:19:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:19:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Instance spawned successfully.
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:19:38 user nova-compute[75288]: INFO nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-b605d6ee-29ff-4b7d-b114-b1aeca114349 req-d98e32f3-4451-4025-8fa2-5539a040cb3a service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b605d6ee-29ff-4b7d-b114-b1aeca114349 req-d98e32f3-4451-4025-8fa2-5539a040cb3a service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b605d6ee-29ff-4b7d-b114-b1aeca114349 req-d98e32f3-4451-4025-8fa2-5539a040cb3a service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b605d6ee-29ff-4b7d-b114-b1aeca114349 req-d98e32f3-4451-4025-8fa2-5539a040cb3a service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-b605d6ee-29ff-4b7d-b114-b1aeca114349 req-d98e32f3-4451-4025-8fa2-5539a040cb3a service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:19:38 user nova-compute[75288]: WARNING nova.compute.manager [req-b605d6ee-29ff-4b7d-b114-b1aeca114349 req-d98e32f3-4451-4025-8fa2-5539a040cb3a service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received unexpected event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with vm_state building and task_state spawning.
Nov 10 23:19:38 user nova-compute[75288]: INFO nova.compute.manager [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Took 30.47 seconds to build instance.
Nov 10 23:19:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2c79e7c-302c-4773-9998-eb9173f7034c tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.569s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c is timed out.
Nov 10 23:19:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully detached device vdb from instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c from the live domain config.
Nov 10 23:19:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIWaVCXe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:19:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:19:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:19:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef545b9d-647a-4835-a46a-97b7c9d1f3be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:19:39 user nova-compute[75288]: No targets found.
Nov 10 23:19:39 user nova-compute[75288]: iSNS:
Nov 10 23:19:39 user nova-compute[75288]: No targets found.
Nov 10 23:19:39 user nova-compute[75288]: STATIC:
Nov 10 23:19:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674
Nov 10 23:19:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:19:39 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:19:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc
Nov 10 23:19:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:19:39 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:19:39 user nova-compute[75288]: FIRMWARE:
Nov 10 23:19:39 user nova-compute[75288]: No targets found.
Nov 10 23:19:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:19:39 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:19:39 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd860ae-1590-4025-afed-8008aa02022c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4818f47-8641-4f96-947c-b83cfd439476]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:19:39 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:19:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc (non-flash)
Nov 10 23:19:39 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:19:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10357be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81229f3a-24d5-474a-a72c-aeb34da35c8a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8da572-36b9-4d2e-b089-97cd4e163317]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[414788df-163e-4c33-bfcc-864a9d5da7c3]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f749f-0c90-4e40-82cb-bd8796029e34]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7982d4f-c217-4f57-983c-8cce955ab019]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d77789c-717d-49d7-ae5b-7f98a42b7877]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260]
Nov 10 23:19:39 user nova-compute[75288]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc, portal: 172.16.0.220,3260] successful.
Nov 10 23:19:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b0fd6-48b1-4512-aacf-8310f093ba7b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== disconnect_volume: return (313ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'flavor' on Instance uuid 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c7f39cc6-abad-423d-ac5c-c84415355a34 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.612s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 28.485s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:47 user nova-compute[75288]: INFO nova.compute.manager [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Terminating instance
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a4aaf31-acbb-49c6-ac58-02cc00f1dde6 req-1f3ebaaf-8b81-40ca-8b57-e021e2942391 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-vif-unplugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a4aaf31-acbb-49c6-ac58-02cc00f1dde6 req-1f3ebaaf-8b81-40ca-8b57-e021e2942391 service nova] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a4aaf31-acbb-49c6-ac58-02cc00f1dde6 req-1f3ebaaf-8b81-40ca-8b57-e021e2942391 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a4aaf31-acbb-49c6-ac58-02cc00f1dde6 req-1f3ebaaf-8b81-40ca-8b57-e021e2942391 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a4aaf31-acbb-49c6-ac58-02cc00f1dde6 req-1f3ebaaf-8b81-40ca-8b57-e021e2942391 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] No waiting events found dispatching network-vif-unplugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a4aaf31-acbb-49c6-ac58-02cc00f1dde6 req-1f3ebaaf-8b81-40ca-8b57-e021e2942391 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-vif-unplugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Instance destroyed successfully.
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lazy-loading 'resources' on Instance uuid 3ff16f2e-4472-4f9d-9b57-df9389db5c9c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1171807867',display_name='tempest-VolumesSnapshotTestJSON-instance-1171807867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1171807867',id=49,image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZMWJ5ZMYC0wTq18MK4CX/A3OqZSMI2E1sRsJEZXcpF2OAKw8PAGFd5tT1cIlD/v7jSWXsvbI6Lj95YQ5hhaSh4SVB0iNZd1lCy3dwOIQB0gElvLH6uwBKBDRggO8OyPA==',key_name='tempest-keypair-1891725832',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:16:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142de0a2567d467a80099c49d749be32',ramdisk_id='',reservation_id='r-onksiwg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f7c29f6c-dbb5-44ff-8be6-262881085121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-234690226',owner_user_name='tempest-VolumesSnapshotTestJSON-234690226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:16:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='668bc2c5df874686a40bd7db9e2ae448',uuid=3ff16f2e-4472-4f9d-9b57-df9389db5c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converting VIF {"id": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "address": "fa:16:3e:e6:ce:4d", "network": {"id": "3915e037-b1ed-4493-b598-cc8e2631e7f3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1729469855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142de0a2567d467a80099c49d749be32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168e61b3-bb", "ovs_interfaceid": "168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ce:4d,bridge_name='br-int',has_traffic_filtering=True,id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168e61b3-bb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_vif [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ce:4d,bridge_name='br-int',has_traffic_filtering=True,id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168e61b3-bb') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap168e61b3-bb, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61e5976c-39de-494b-b01f-84c953bf950c) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:19:47 user nova-compute[75288]: INFO os_vif [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ce:4d,bridge_name='br-int',has_traffic_filtering=True,id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8,network=Network(3915e037-b1ed-4493-b598-cc8e2631e7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168e61b3-bb')
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIWaVCXe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:19:47 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cbb260-a046-4cb0-b91f-61ddc38e2ede]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:19:47 user nova-compute[75288]: No targets found.
Nov 10 23:19:47 user nova-compute[75288]: iSNS:
Nov 10 23:19:47 user nova-compute[75288]: No targets found.
Nov 10 23:19:47 user nova-compute[75288]: STATIC:
Nov 10 23:19:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674
Nov 10 23:19:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:19:47 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:19:47 user nova-compute[75288]: FIRMWARE:
Nov 10 23:19:47 user nova-compute[75288]: No targets found.
Nov 10 23:19:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:19:47 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:19:47 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bf0327f-1bda-47e1-8bfb-5d80b6afbebc', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2f4a70-be8e-450b-b19f-be6924ef9349]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e74f916-6040-4ec1-9951-d129b7dec982]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:19:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:19:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b2834a3b0>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] <== disconnect_volume: return (83ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:19:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:19:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Deleting instance files /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c_del
Nov 10 23:19:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Deletion of /opt/stack/data/nova/instances/3ff16f2e-4472-4f9d-9b57-df9389db5c9c_del complete
Nov 10 23:19:48 user nova-compute[75288]: INFO nova.compute.manager [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 10 23:19:48 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:19:48 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:19:48 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:19:49 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Took 1.17 seconds to deallocate network for instance.
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-95c40597-a5c7-49f1-9c2e-afd906192267 req-f6b895c5-2745-4752-a600-560302f7c5c5 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-vif-deleted-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:19:49 user nova-compute[75288]: INFO nova.compute.manager [req-95c40597-a5c7-49f1-9c2e-afd906192267 req-f6b895c5-2745-4752-a600-560302f7c5c5 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Neutron deleted interface 168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8; detaching it from the instance and deleting it from the info cache
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-95c40597-a5c7-49f1-9c2e-afd906192267 req-f6b895c5-2745-4752-a600-560302f7c5c5 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-95c40597-a5c7-49f1-9c2e-afd906192267 req-f6b895c5-2745-4752-a600-560302f7c5c5 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Detach interface failed, port_id=168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8, reason: Instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 23:19:49 user nova-compute[75288]: WARNING nova.volume.cinder [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Attachment 8cd346f8-99d7-4bb6-abfb-af146d57b42b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8cd346f8-99d7-4bb6-abfb-af146d57b42b. (HTTP 404) (Request-ID: req-288167bf-e6c6-4d5c-b0ac-b1e30b64ba03)
Nov 10 23:19:49 user nova-compute[75288]: INFO nova.compute.manager [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 23:19:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:49 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Deleted allocations for instance 3ff16f2e-4472-4f9d-9b57-df9389db5c9c
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-51370cd8-f3ab-4046-ad98-d4bb674ccd3a req-ddeb1bc8-8f14-40a1-9cea-7886eaf32515 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received event network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-51370cd8-f3ab-4046-ad98-d4bb674ccd3a req-ddeb1bc8-8f14-40a1-9cea-7886eaf32515 service nova] Acquiring lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-51370cd8-f3ab-4046-ad98-d4bb674ccd3a req-ddeb1bc8-8f14-40a1-9cea-7886eaf32515 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-51370cd8-f3ab-4046-ad98-d4bb674ccd3a req-ddeb1bc8-8f14-40a1-9cea-7886eaf32515 service nova] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-51370cd8-f3ab-4046-ad98-d4bb674ccd3a req-ddeb1bc8-8f14-40a1-9cea-7886eaf32515 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] No waiting events found dispatching network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:19:49 user nova-compute[75288]: WARNING nova.compute.manager [req-51370cd8-f3ab-4046-ad98-d4bb674ccd3a req-ddeb1bc8-8f14-40a1-9cea-7886eaf32515 service nova] [instance: 3ff16f2e-4472-4f9d-9b57-df9389db5c9c] Received unexpected event network-vif-plugged-168e61b3-bb26-4ee2-9f4e-d97ba7b7b1c8 for instance with vm_state deleted and task_state None.
Nov 10 23:19:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-de2af970-ca11-4c53-bfb2-111ffc71dbb5 tempest-VolumesSnapshotTestJSON-234690226 tempest-VolumesSnapshotTestJSON-234690226-project-member] Lock "3ff16f2e-4472-4f9d-9b57-df9389db5c9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.546s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:51 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:51 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:19:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:19:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:19:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:19:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.066425323486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 4c800323-9afa-4bc7-bce1-58a254ea01fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:19:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 4c800323-9afa-4bc7-bce1-58a254ea01fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:19:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:19:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:19:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:20:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:20:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:20:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:20:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:20:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:20:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:20:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:20:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:20:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:20:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:20:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:20:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:20:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:20:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:20:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:20:53 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:20:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:20:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:20:53 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:20:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:20:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:20:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=25.0567626953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 4c800323-9afa-4bc7-bce1-58a254ea01fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:20:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:20:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:20:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 4c800323-9afa-4bc7-bce1-58a254ea01fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:20:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:20:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:20:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-changed-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:20:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Refreshing instance network info cache due to event network-changed-e734cd63-eb70-4202-81c4-9d93a89b840d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:20:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:20:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:20:59 user nova-compute[75288]: DEBUG nova.network.neutron [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Refreshing network info cache for port e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:20:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updated VIF entry in instance network info cache for port e734cd63-eb70-4202-81c4-9d93a89b840d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:21:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:21:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1bec2894-e447-43d6-a752-237b0a6cecf9 req-a59d3a3d-e8bf-4675-9042-da2a0a06eae2 service nova] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:21:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:04 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:04 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:21:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 23:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 23:21:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 23:21:19 user nova-compute[75288]: INFO nova.compute.claims [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Claim successful on node user
Nov 10 23:21:19 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:21:19 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 23:21:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 23:21:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG nova.policy [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa19686e14744c0dbbd437aee915f870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2793e892931b4463b6f44fa9bf6da539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 23:21:20 user nova-compute[75288]: INFO nova.virt.block_device [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Booting with volume 5789387f-881e-448b-8cd9-549a85b49470 at /dev/vda
Nov 10 23:21:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab617a2-8af8-480a-ad5b-87d31827fb0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77fff760b050\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b4535-9b76-4690-a737-e7ed791f3190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f5d4ac-0bb0-4e71-9d9b-3de398fe33db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6713fa8-0efb-492c-bfe7-342702312d5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 23:21:20 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 23:21:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18655fd-3623-4961-8cef-71a0484038e5]: (4, '') {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG os_brick.utils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77fff760b050', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating existing volume attachment record: f69abd07-63e9-4f9b-ab65-f363b8474551 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Successfully created port: 7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Successfully updated port: 7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquired lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-changed-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Refreshing instance network info cache due to event network-changed-7f18f67d-9ea1-40a2-be5d-07c75309ca1d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] Acquiring lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating instance_info_cache with network_info: [{"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Releasing lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Instance network_info: |[{"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] Acquired lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:21:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Refreshing network info cache for port 7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:21:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updated VIF entry in instance network info cache for port 7f18f67d-9ea1-40a2-be5d-07c75309ca1d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:21:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating instance_info_cache with network_info: [{"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:21:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d5b0abe3-80e8-4fca-9765-c64f907e9d61 req-ec69c8fb-f26d-4cc9-b564-fad57bb69453 service nova] Releasing lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:21:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:21:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 23:21:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Creating image(s)
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Ensure instance console log exists: /opt/stack/data/nova/instances/5092c059-bbae-49be-bc95-9f96660ec1e3/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Start _get_guest_xml network_info=[{"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbqwUjaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5092c059-bbae-49be-bc95-9f96660ec1e3', 'attached_at': '', 'detached_at': '', 'volume_id': '5789387f-881e-448b-8cd9-549a85b49470', 'serial': '5789387f-881e-448b-8cd9-549a85b49470'}, 'mount_device': '/dev/vda', 'attachment_id': 'f69abd07-63e9-4f9b-ab65-f363b8474551', 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 23:21:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:21:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T22:30:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbqwUjaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:21:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:21:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:21:44 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2abb78-d287-4a57-97ad-3e173035cb9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 23:21:44 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --interface default --op new {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e8563-2bf0-4568-8f4f-b44895cb85a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470] added\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470] added
Nov 10 23:21:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8a194-9917-4bfc-a339-b38a0b219039]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3389491-350a-43cf-86e4-a170ae7fe38c]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dbqwUjaQ {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dbqwUjaQ" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca7c537-0d76-48a8-8231-7001a14fb567]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dbqwUjaQ'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295dcd7-d349-4342-882e-d4308f091d90]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b166713-e63c-4644-bd02-05b838eda466]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:21:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:21:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --login {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c735f9ac-17c0-42e7-ba99-2bcd2183771d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260]
Nov 10 23:21:44 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260] successful.
Nov 10 23:21:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce43bc3-ee10-44c2-b369-b56ba52134ab]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b339004-dd79-4347-9d73-7e412aff1a8a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:21:44 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 (non-flash)
Nov 10 23:21:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:21:44 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 (non-flash)
Nov 10 23:21:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9aa5ff-60aa-4d28-b55f-9755a4dc4844]: (4, ('- - 0', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 23:21:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbqwUjaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23961343535313032', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961343535313032', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1329395501',display_name='tempest-TestVolumeBootPattern-server-1329395501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1329395501',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-368ac30h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:21:20Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=5092c059-bbae-49be-bc95-9f96660ec1e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:8c:0c,bridge_name='br-int',has_traffic_filtering=True,id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f18f67d-9e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'pci_devices' on Instance uuid 5092c059-bbae-49be-bc95-9f96660ec1e3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 23:21:45 user nova-compute[75288]:   <uuid>5092c059-bbae-49be-bc95-9f96660ec1e3</uuid>
Nov 10 23:21:45 user nova-compute[75288]:   <name>instance-00000034</name>
Nov 10 23:21:45 user nova-compute[75288]:   <memory>524288</memory>
Nov 10 23:21:45 user nova-compute[75288]:   <vcpu>1</vcpu>
Nov 10 23:21:45 user nova-compute[75288]:   <metadata>
Nov 10 23:21:45 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 23:21:45 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Nov 10 23:21:45 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-1329395501</nova:name>
Nov 10 23:21:45 user nova-compute[75288]:       <nova:creationTime>2023-11-10 23:21:44</nova:creationTime>
Nov 10 23:21:45 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Nov 10 23:21:45 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Nov 10 23:21:45 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Nov 10 23:21:45 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Nov 10 23:21:45 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 23:21:45 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Nov 10 23:21:45 user nova-compute[75288]:       </nova:flavor>
Nov 10 23:21:45 user nova-compute[75288]:       <nova:owner>
Nov 10 23:21:45 user nova-compute[75288]:         <nova:user uuid="aa19686e14744c0dbbd437aee915f870">tempest-TestVolumeBootPattern-799029960-project-member</nova:user>
Nov 10 23:21:45 user nova-compute[75288]:         <nova:project uuid="2793e892931b4463b6f44fa9bf6da539">tempest-TestVolumeBootPattern-799029960</nova:project>
Nov 10 23:21:45 user nova-compute[75288]:       </nova:owner>
Nov 10 23:21:45 user nova-compute[75288]:       <nova:ports>
Nov 10 23:21:45 user nova-compute[75288]:         <nova:port uuid="7f18f67d-9ea1-40a2-be5d-07c75309ca1d">
Nov 10 23:21:45 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 23:21:45 user nova-compute[75288]:         </nova:port>
Nov 10 23:21:45 user nova-compute[75288]:       </nova:ports>
Nov 10 23:21:45 user nova-compute[75288]:     </nova:instance>
Nov 10 23:21:45 user nova-compute[75288]:   </metadata>
Nov 10 23:21:45 user nova-compute[75288]:   <sysinfo type="smbios">
Nov 10 23:21:45 user nova-compute[75288]:     <system>
Nov 10 23:21:45 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 23:21:45 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Nov 10 23:21:45 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Nov 10 23:21:45 user nova-compute[75288]:       <entry name="serial">5092c059-bbae-49be-bc95-9f96660ec1e3</entry>
Nov 10 23:21:45 user nova-compute[75288]:       <entry name="uuid">5092c059-bbae-49be-bc95-9f96660ec1e3</entry>
Nov 10 23:21:45 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Nov 10 23:21:45 user nova-compute[75288]:     </system>
Nov 10 23:21:45 user nova-compute[75288]:   </sysinfo>
Nov 10 23:21:45 user nova-compute[75288]:   <os>
Nov 10 23:21:45 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 23:21:45 user nova-compute[75288]:     <boot dev="hd"/>
Nov 10 23:21:45 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Nov 10 23:21:45 user nova-compute[75288]:   </os>
Nov 10 23:21:45 user nova-compute[75288]:   <features>
Nov 10 23:21:45 user nova-compute[75288]:     <acpi/>
Nov 10 23:21:45 user nova-compute[75288]:     <apic/>
Nov 10 23:21:45 user nova-compute[75288]:     <vmcoreinfo/>
Nov 10 23:21:45 user nova-compute[75288]:   </features>
Nov 10 23:21:45 user nova-compute[75288]:   <clock offset="utc">
Nov 10 23:21:45 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 23:21:45 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 23:21:45 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Nov 10 23:21:45 user nova-compute[75288]:   </clock>
Nov 10 23:21:45 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Nov 10 23:21:45 user nova-compute[75288]:     <model>Nehalem</model>
Nov 10 23:21:45 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 23:21:45 user nova-compute[75288]:   </cpu>
Nov 10 23:21:45 user nova-compute[75288]:   <devices>
Nov 10 23:21:45 user nova-compute[75288]:     <disk type="block" device="disk">
Nov 10 23:21:45 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 23:21:45 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Nov 10 23:21:45 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Nov 10 23:21:45 user nova-compute[75288]:       <serial>5789387f-881e-448b-8cd9-549a85b49470</serial>
Nov 10 23:21:45 user nova-compute[75288]:     </disk>
Nov 10 23:21:45 user nova-compute[75288]:     <interface type="ethernet">
Nov 10 23:21:45 user nova-compute[75288]:       <mac address="fa:16:3e:14:8c:0c"/>
Nov 10 23:21:45 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:21:45 user nova-compute[75288]:       <mtu size="1442"/>
Nov 10 23:21:45 user nova-compute[75288]:       <target dev="tap7f18f67d-9e"/>
Nov 10 23:21:45 user nova-compute[75288]:     </interface>
Nov 10 23:21:45 user nova-compute[75288]:     <serial type="pty">
Nov 10 23:21:45 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/5092c059-bbae-49be-bc95-9f96660ec1e3/console.log" append="off"/>
Nov 10 23:21:45 user nova-compute[75288]:     </serial>
Nov 10 23:21:45 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 23:21:45 user nova-compute[75288]:     <video>
Nov 10 23:21:45 user nova-compute[75288]:       <model type="virtio"/>
Nov 10 23:21:45 user nova-compute[75288]:     </video>
Nov 10 23:21:45 user nova-compute[75288]:     <rng model="virtio">
Nov 10 23:21:45 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Nov 10 23:21:45 user nova-compute[75288]:     </rng>
Nov 10 23:21:45 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Nov 10 23:21:45 user nova-compute[75288]:     <memballoon model="virtio">
Nov 10 23:21:45 user nova-compute[75288]:       <stats period="10"/>
Nov 10 23:21:45 user nova-compute[75288]:     </memballoon>
Nov 10 23:21:45 user nova-compute[75288]:   </devices>
Nov 10 23:21:45 user nova-compute[75288]: </domain>
Nov 10 23:21:45 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1329395501',display_name='tempest-TestVolumeBootPattern-server-1329395501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1329395501',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-368ac30h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T23:21:20Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=5092c059-bbae-49be-bc95-9f96660ec1e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:8c:0c,bridge_name='br-int',has_traffic_filtering=True,id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f18f67d-9e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG os_vif [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:8c:0c,bridge_name='br-int',has_traffic_filtering=True,id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f18f67d-9e') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f38a4d42-07ad-574a-8d90-2fa0828cdd97', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f18f67d-9e, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f18f67d-9e, col_values=(('qos', UUID('dbcb8387-d755-4b22-b05f-7d7793799195')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:21:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f18f67d-9e, col_values=(('external_ids', {'iface-id': '7f18f67d-9ea1-40a2-be5d-07c75309ca1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:8c:0c', 'vm-uuid': '5092c059-bbae-49be-bc95-9f96660ec1e3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:46 user nova-compute[75288]: INFO os_vif [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:8c:0c,bridge_name='br-int',has_traffic_filtering=True,id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f18f67d-9e')
Nov 10 23:21:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] No VIF found with MAC fa:16:3e:14:8c:0c, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 23:21:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: b9342997-048d-4f4f-a552-de76f2a0a444] Instance has had 5 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9119b85-13d0-4a24-bd8d-cd715521c6f8 req-5a490fc4-fd37-4ef1-9923-a06c06a1a4ea service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9119b85-13d0-4a24-bd8d-cd715521c6f8 req-5a490fc4-fd37-4ef1-9923-a06c06a1a4ea service nova] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9119b85-13d0-4a24-bd8d-cd715521c6f8 req-5a490fc4-fd37-4ef1-9923-a06c06a1a4ea service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9119b85-13d0-4a24-bd8d-cd715521c6f8 req-5a490fc4-fd37-4ef1-9923-a06c06a1a4ea service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9119b85-13d0-4a24-bd8d-cd715521c6f8 req-5a490fc4-fd37-4ef1-9923-a06c06a1a4ea service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] No waiting events found dispatching network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:21:47 user nova-compute[75288]: WARNING nova.compute.manager [req-b9119b85-13d0-4a24-bd8d-cd715521c6f8 req-5a490fc4-fd37-4ef1-9923-a06c06a1a4ea service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received unexpected event network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d for instance with vm_state building and task_state spawning.
Nov 10 23:21:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 23:21:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Instance spawned successfully.
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 23:21:49 user nova-compute[75288]: INFO nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-3c6a0563-1d27-42fe-956d-358de63a4e51 req-e0254dbf-f815-4962-81bf-a42bdd0eb8b9 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3c6a0563-1d27-42fe-956d-358de63a4e51 req-e0254dbf-f815-4962-81bf-a42bdd0eb8b9 service nova] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3c6a0563-1d27-42fe-956d-358de63a4e51 req-e0254dbf-f815-4962-81bf-a42bdd0eb8b9 service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3c6a0563-1d27-42fe-956d-358de63a4e51 req-e0254dbf-f815-4962-81bf-a42bdd0eb8b9 service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-3c6a0563-1d27-42fe-956d-358de63a4e51 req-e0254dbf-f815-4962-81bf-a42bdd0eb8b9 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] No waiting events found dispatching network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:21:49 user nova-compute[75288]: WARNING nova.compute.manager [req-3c6a0563-1d27-42fe-956d-358de63a4e51 req-e0254dbf-f815-4962-81bf-a42bdd0eb8b9 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received unexpected event network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d for instance with vm_state building and task_state spawning.
Nov 10 23:21:49 user nova-compute[75288]: INFO nova.compute.manager [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Took 30.00 seconds to build instance.
Nov 10 23:21:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-38d529fd-0eb7-432d-8f5a-5a4387a6c24f tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.088s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 4c800323-9afa-4bc7-bce1-58a254ea01fd {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Triggering sync for uuid 5092c059-bbae-49be-bc95-9f96660ec1e3 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:54 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:54 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:21:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:21:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:21:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:21:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.054256439208984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 4c800323-9afa-4bc7-bce1-58a254ea01fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5092c059-bbae-49be-bc95-9f96660ec1e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:21:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:21:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 4c800323-9afa-4bc7-bce1-58a254ea01fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:21:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:21:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:21:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:22:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:22:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:22:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:22:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:22:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:22:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:22:56 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:22:56 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.05268096923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 4c800323-9afa-4bc7-bce1-58a254ea01fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 5092c059-bbae-49be-bc95-9f96660ec1e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating instance_info_cache with network_info: [{"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:22:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:23:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:23:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-changed-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:23:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Refreshing instance network info cache due to event network-changed-7f18f67d-9ea1-40a2-be5d-07c75309ca1d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:23:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] Acquiring lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:23:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] Acquired lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:23:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Refreshing network info cache for port 7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updated VIF entry in instance network info cache for port 7f18f67d-9ea1-40a2-be5d-07c75309ca1d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating instance_info_cache with network_info: [{"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-771579f2-053f-449b-a9b4-81dbbc483d6b req-d54c0348-818f-4783-87c3-b58168cbfc71 service nova] Releasing lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-changed-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Refreshing instance network info cache due to event network-changed-7f18f67d-9ea1-40a2-be5d-07c75309ca1d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] Acquiring lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] Acquired lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Refreshing network info cache for port 7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:23:12 user nova-compute[75288]: INFO nova.compute.manager [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Terminating instance
Nov 10 23:23:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updated VIF entry in instance network info cache for port 7f18f67d-9ea1-40a2-be5d-07c75309ca1d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating instance_info_cache with network_info: [{"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbe79afe-3604-431e-bdd2-5fa0e5fbb191 req-a8827b7c-2d1a-47cf-abdc-12c378900aef service nova] Releasing lock "refresh_cache-5092c059-bbae-49be-bc95-9f96660ec1e3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:23:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Instance destroyed successfully.
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'resources' on Instance uuid 5092c059-bbae-49be-bc95-9f96660ec1e3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1329395501',display_name='tempest-TestVolumeBootPattern-server-1329395501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1329395501',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-368ac30h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:21:50Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=5092c059-bbae-49be-bc95-9f96660ec1e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "address": "fa:16:3e:14:8c:0c", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f18f67d-9e", "ovs_interfaceid": "7f18f67d-9ea1-40a2-be5d-07c75309ca1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:8c:0c,bridge_name='br-int',has_traffic_filtering=True,id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f18f67d-9e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_vif [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:8c:0c,bridge_name='br-int',has_traffic_filtering=True,id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f18f67d-9e') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f18f67d-9e, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbcb8387-d755-4b22-b05f-7d7793799195) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:13 user nova-compute[75288]: INFO os_vif [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:8c:0c,bridge_name='br-int',has_traffic_filtering=True,id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f18f67d-9e')
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbqwUjaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:23:13 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eba3d26-7886-4a0f-8e6c-7657201d04f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:23:13 user nova-compute[75288]: No targets found.
Nov 10 23:23:13 user nova-compute[75288]: iSNS:
Nov 10 23:23:13 user nova-compute[75288]: No targets found.
Nov 10 23:23:13 user nova-compute[75288]: STATIC:
Nov 10 23:23:13 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674
Nov 10 23:23:13 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:23:13 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:23:13 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470
Nov 10 23:23:13 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:23:13 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:23:13 user nova-compute[75288]: FIRMWARE:
Nov 10 23:23:13 user nova-compute[75288]: No targets found.
Nov 10 23:23:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:23:13 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:23:13 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaffed5-2cc6-4fe4-aa8c-cf5b59bd38c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8957bcb4-8da3-4669-88e3-232eab5b5cd1]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:23:13 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 (non-flash)
Nov 10 23:23:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:23:13 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 (non-flash)
Nov 10 23:23:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b103852d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da56a510-c996-4865-8a57-487c7eb7a592]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6600d521-6a51-49b3-b773-b6de7abfd41f]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aedeba-0224-4c6e-a8d2-372f2c3d923b]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d0d1b2-9c7d-47ff-b128-8b7cfd083435]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[153130c7-2492-4928-ad41-c030e8971763]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3024b1a-fad9-42ed-befe-7dd69a920ca4]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260]
Nov 10 23:23:13 user nova-compute[75288]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470, portal: 172.16.0.220,3260] successful.
Nov 10 23:23:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5789387f-881e-448b-8cd9-549a85b49470 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15695e-547a-44c2-b3fd-f33a7b78a293]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== disconnect_volume: return (307ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:23:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:23:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Deleting instance files /opt/stack/data/nova/instances/5092c059-bbae-49be-bc95-9f96660ec1e3_del
Nov 10 23:23:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Deletion of /opt/stack/data/nova/instances/5092c059-bbae-49be-bc95-9f96660ec1e3_del complete
Nov 10 23:23:14 user nova-compute[75288]: INFO nova.compute.manager [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 10 23:23:14 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd7b2ae8-082b-4e1a-8c41-1d4bf83666ab req-071398f4-2feb-4639-a934-132aa8be7e2c service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-vif-deleted-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:23:14 user nova-compute[75288]: INFO nova.compute.manager [req-bd7b2ae8-082b-4e1a-8c41-1d4bf83666ab req-071398f4-2feb-4639-a934-132aa8be7e2c service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Neutron deleted interface 7f18f67d-9ea1-40a2-be5d-07c75309ca1d; detaching it from the instance and deleting it from the info cache
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-bd7b2ae8-082b-4e1a-8c41-1d4bf83666ab req-071398f4-2feb-4639-a934-132aa8be7e2c service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:23:14 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Took 0.40 seconds to deallocate network for instance.
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd7b2ae8-082b-4e1a-8c41-1d4bf83666ab req-071398f4-2feb-4639-a934-132aa8be7e2c service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Detach interface failed, port_id=7f18f67d-9ea1-40a2-be5d-07c75309ca1d, reason: Instance 5092c059-bbae-49be-bc95-9f96660ec1e3 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-vif-unplugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] No waiting events found dispatching network-vif-unplugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-vif-unplugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received event network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] Acquiring lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:23:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] No waiting events found dispatching network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:23:14 user nova-compute[75288]: WARNING nova.compute.manager [req-f8d9e1cb-fbed-4534-9cff-f7872fc530d8 req-f39fd8e4-0cbe-4dd5-93bd-980a41e3e4e2 service nova] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Received unexpected event network-vif-plugged-7f18f67d-9ea1-40a2-be5d-07c75309ca1d for instance with vm_state active and task_state deleting.
Nov 10 23:23:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:15 user nova-compute[75288]: INFO nova.compute.manager [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 5092c059-bbae-49be-bc95-9f96660ec1e3] Took 1.03 seconds to detach 1 volumes for instance.
Nov 10 23:23:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:23:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:23:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:23:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:23:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:23:15 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Deleted allocations for instance 5092c059-bbae-49be-bc95-9f96660ec1e3
Nov 10 23:23:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3df3faa7-ca9d-4996-9cdf-3d08abfb8aeb tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "5092c059-bbae-49be-bc95-9f96660ec1e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:23:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:23:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:23:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:23:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:23:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:23:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:23:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:23:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:23:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:23:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:23:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:23:57 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:23:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 23:23:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:23:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:23:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=25.051513671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Instance 4c800323-9afa-4bc7-bce1-58a254ea01fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:23:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lazy-loading 'info_cache' on Instance uuid 4c800323-9afa-4bc7-bce1-58a254ea01fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:24:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 23:24:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:04 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:24:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:12 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-changed-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Refreshing instance network info cache due to event network-changed-e734cd63-eb70-4202-81c4-9d93a89b840d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] Acquiring lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] Acquired lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG nova.network.neutron [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Refreshing network info cache for port e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:28 user nova-compute[75288]: INFO nova.compute.manager [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Terminating instance
Nov 10 23:24:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updated VIF entry in instance network info cache for port e734cd63-eb70-4202-81c4-9d93a89b840d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [{"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f3f5c8d4-c302-4a75-b451-d8d23e22fcbd req-f196701a-36b2-44b0-ab37-0ec1a8b07bf7 service nova] Releasing lock "refresh_cache-4c800323-9afa-4bc7-bce1-58a254ea01fd" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Instance destroyed successfully.
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lazy-loading 'resources' on Instance uuid 4c800323-9afa-4bc7-bce1-58a254ea01fd {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T23:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-635496987',display_name='tempest-TestVolumeBootPattern-server-635496987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-635496987',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPnHu2svbeDivKmFCOzhvL5Xh/8r7i+NlJj94o1vOWRpN1hpUthYdXhS11UqWi+nCMmkrCW0rOqYn5Th0yH6bckWnkj98wXtyU7yN3mSHhNM8uj8qVF5yk/WU+bLPyrw==',key_name='tempest-TestVolumeBootPattern-1515766004',keypairs=<?>,launch_index=0,launched_at=2023-11-10T23:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2793e892931b4463b6f44fa9bf6da539',ramdisk_id='',reservation_id='r-pa22k44j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-799029960',owner_user_name='tempest-TestVolumeBootPattern-799029960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T23:19:39Z,user_data=None,user_id='aa19686e14744c0dbbd437aee915f870',uuid=4c800323-9afa-4bc7-bce1-58a254ea01fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converting VIF {"id": "e734cd63-eb70-4202-81c4-9d93a89b840d", "address": "fa:16:3e:a5:ca:73", "network": {"id": "63a81a57-e81a-423d-9893-eba778a1e8e8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1004017727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2793e892931b4463b6f44fa9bf6da539", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape734cd63-eb", "ovs_interfaceid": "e734cd63-eb70-4202-81c4-9d93a89b840d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=e734cd63-eb70-4202-81c4-9d93a89b840d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape734cd63-eb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_vif [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=e734cd63-eb70-4202-81c4-9d93a89b840d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape734cd63-eb') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape734cd63-eb, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf9ee5f9-7698-40b7-922c-595434a657fd) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:24:29 user nova-compute[75288]: INFO os_vif [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=e734cd63-eb70-4202-81c4-9d93a89b840d,network=Network(63a81a57-e81a-423d-9893-eba778a1e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape734cd63-eb')
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b10731810>, {'target_iqn': 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeKVoLQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 23:24:29 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[979828e4-ce08-496a-ab5a-a765b32a189d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 23:24:29 user nova-compute[75288]: No targets found.
Nov 10 23:24:29 user nova-compute[75288]: iSNS:
Nov 10 23:24:29 user nova-compute[75288]: No targets found.
Nov 10 23:24:29 user nova-compute[75288]: STATIC:
Nov 10 23:24:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674
Nov 10 23:24:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Nov 10 23:24:29 user nova-compute[75288]:                 Iface Name: default
Nov 10 23:24:29 user nova-compute[75288]: FIRMWARE:
Nov 10 23:24:29 user nova-compute[75288]: No targets found.
Nov 10 23:24:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 23:24:29 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 23:24:29 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df1a8b7-85aa-4bd2-8b36-8730999d3989]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ae4b3-5a97-46f7-9ad0-a6606322e0d6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:24:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 (non-flash)
Nov 10 23:24:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b10324af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8e56e-923b-45a6-a52f-51b534a3cb36]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ebab4-6bfa-4636-949d-d806f8c3f96c]: (4, ('ok\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a60c93d-f021-45bc-a1a9-ed5461c68dee]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c5e69-46c0-4b4f-aefa-d38835ea07ed]: (4, ('1', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_47fd220c',) {{(pid=86709) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4b52ff-d4e1-42a0-a7d4-457d7e8881e8]: (4, None) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[604c25ce-3cda-4376-9226-89a3815dbf06]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --logout {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[183353bc-8b95-451e-86d7-c5cc1e2b798c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260]
Nov 10 23:24:29 user nova-compute[75288]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674, portal: 172.16.0.220,3260] successful.
Nov 10 23:24:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op delete {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ee8335-d6d1-4764-bcc7-8d8e6f153674 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86709) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e0ffc8-bff1-4897-adc3-e49139926683]: (4, ('', '')) {{(pid=86709) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] <== disconnect_volume: return (309ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 23:24:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Deleting instance files /opt/stack/data/nova/instances/4c800323-9afa-4bc7-bce1-58a254ea01fd_del
Nov 10 23:24:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Deletion of /opt/stack/data/nova/instances/4c800323-9afa-4bc7-bce1-58a254ea01fd_del complete
Nov 10 23:24:29 user nova-compute[75288]: INFO nova.compute.manager [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 10 23:24:29 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 23:24:29 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 23:24:30 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Took 0.58 seconds to deallocate network for instance.
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-unplugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-unplugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-unplugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:24:30 user nova-compute[75288]: WARNING nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received unexpected event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with vm_state active and task_state deleting.
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:24:30 user nova-compute[75288]: WARNING nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received unexpected event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with vm_state active and task_state deleting.
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:24:30 user nova-compute[75288]: WARNING nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received unexpected event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with vm_state active and task_state deleting.
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-unplugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-unplugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-unplugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Acquiring lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] No waiting events found dispatching network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 23:24:30 user nova-compute[75288]: WARNING nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received unexpected event network-vif-plugged-e734cd63-eb70-4202-81c4-9d93a89b840d for instance with vm_state active and task_state deleting.
Nov 10 23:24:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c56f59fa-34e2-42f3-98ad-a03b4b66ea08 req-9aa47d5c-7085-4034-bb03-0e5a4d3bb9ee service nova] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Received event network-vif-deleted-e734cd63-eb70-4202-81c4-9d93a89b840d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 23:24:31 user nova-compute[75288]: INFO nova.compute.manager [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] [instance: 4c800323-9afa-4bc7-bce1-58a254ea01fd] Took 0.97 seconds to detach 1 volumes for instance.
Nov 10 23:24:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:31 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:24:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:24:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:31 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Deleted allocations for instance 4c800323-9afa-4bc7-bce1-58a254ea01fd
Nov 10 23:24:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73f96416-5ad5-452e-943a-1ced3e12ac64 tempest-TestVolumeBootPattern-799029960 tempest-TestVolumeBootPattern-799029960-project-member] Lock "4c800323-9afa-4bc7-bce1-58a254ea01fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.065s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:24:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:24:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:24:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:24:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:24:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:24:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:24:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:24:59 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:24:59 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:24:59 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=9106MB free_disk=25.050430297851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:24:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 23:25:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 23:25:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 23:25:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 23:25:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:10 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:25:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:25:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:25:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:25:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:25:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:25:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:25:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 23:25:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:25:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 23:25:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:25:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 23:25:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 23:26:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 23:26:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:26:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:26:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 23:26:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 23:26:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:26:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Hypervisor/Node resource view: name=user free_ram=9251MB free_disk=25.003273010253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing inventories for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating ProviderTree inventory for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Updating inventory in ProviderTree for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing aggregate associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Refreshing trait associations for resource provider b11c524c-1236-4192-b3e8-15e79f5f3ca6, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed in ProviderTree for provider: b11c524c-1236-4192-b3e8-15e79f5f3ca6 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Inventory has not changed for provider b11c524c-1236-4192-b3e8-15e79f5f3ca6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 23:26:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cfc1024-9cfa-45f2-88a0-6dfa5650fd3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}